-- Logs begin at Mon 2022-07-04 08:33:37 UTC, end at Mon 2022-07-04 09:48:29 UTC. -- Jul 04 09:09:11.913183 dv-cinder-819149-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 04 09:09:11.922606 dv-cinder-819149-7-smb devstack@keystone.service[80318]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:09:11 2022] *** Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: nodename: dv-cinder-819149-7-smb Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: machine: x86_64 Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: clock source: unix Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: pcre jit disabled Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: detected number of CPU cores: 4 Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: current working directory: / Jul 04 09:09:11.924636 dv-cinder-819149-7-smb devstack@keystone.service[80318]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: your processes number limit is 47680 Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: your memory page size is 4096 bytes Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: detected max file descriptor number: 2048 Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: lock engine: pthread robust mutexes Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: thunder lock: enabled Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 04 09:09:11.925219 dv-cinder-819149-7-smb devstack@keystone.service[80318]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:09:11.968842 dv-cinder-819149-7-smb devstack@keystone.service[80318]: Python main interpreter initialized at 0x561a227579c0 Jul 04 09:09:11.968842 dv-cinder-819149-7-smb devstack@keystone.service[80318]: python threads support enabled Jul 04 09:09:11.968842 dv-cinder-819149-7-smb devstack@keystone.service[80318]: your server socket listen backlog is limited to 100 connections Jul 04 09:09:11.968842 dv-cinder-819149-7-smb devstack@keystone.service[80318]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:09:11.969212 dv-cinder-819149-7-smb devstack@keystone.service[80318]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:09:11.969282 dv-cinder-819149-7-smb devstack@keystone.service[80318]: *** Operational MODE: preforking *** Jul 04 09:09:11.969541 dv-cinder-819149-7-smb devstack@keystone.service[80318]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:09:11.969541 dv-cinder-819149-7-smb devstack@keystone.service[80318]: spawned uWSGI master process (pid: 80318) Jul 04 09:09:11.969746 dv-cinder-819149-7-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 04 09:09:11.971135 dv-cinder-819149-7-smb devstack@keystone.service[80318]: spawned uWSGI worker 1 (pid: 80330, cores: 1) Jul 04 09:09:11.971135 dv-cinder-819149-7-smb devstack@keystone.service[80318]: spawned uWSGI worker 2 (pid: 80331, cores: 1) Jul 04 09:09:11.971899 dv-cinder-819149-7-smb devstack@keystone.service[80318]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:09:17.468638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:09:17.468638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes Jul 04 09:09:17.469408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:09:17.469408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 04 09:09:17.469849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:09:17.469849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes Jul 04 09:09:17.469981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:09:17.469981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 04 09:09:17.518752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:09:17.518919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:09:17.519056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] command line args: [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:09:17.519160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:09:17.519305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:09:17.519393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:09:17.519473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ================================================================================ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:09:17.519549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] command line args: [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:09:17.519727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.519807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:09:17.519923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ================================================================================ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:09:17.520002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_dir = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_source = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_dir = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] debug = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.520948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_source = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] debug = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.521992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_config_append = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_dir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_config_append = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.522927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_dir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.523924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.524929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.525879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] publish_errors = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.526947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] publish_errors = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.527910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] standard_threads = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] standard_threads = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.528870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_journal = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_json = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_stderr = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_syslog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.529946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_journal = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_json = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_stderr = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.530446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_syslog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.530697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:09:17.530862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.530946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.531918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.532881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.533992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.534862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.535998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.536917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.537858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.538973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.539922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.540826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.541951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.542885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.543976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.544976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.545612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.545778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.545906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.546859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.547804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.548925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.549959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.550932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.551882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.552985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.553984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.554957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.external = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.555923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.external = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.password = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.556893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.token = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.password = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.token = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.557982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.558961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.559910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.560979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.561953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.562980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.563934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.564900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.565857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.566853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.567963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.568985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.569945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.570931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.571877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.572985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.573933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.574970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.575874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.576889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.577974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.578949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.579980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.580908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.581876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.582999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.583942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.584940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.585970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.586943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.587895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.588877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.589967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.590951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.591044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.591195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.591283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.591439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.591694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.592934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.593901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.594078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.594235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.594577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.594749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.594892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.595785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.596892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.597899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.598024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.598148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.609728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.609816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.609986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.610943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.611933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.612938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.613918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614039 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.614982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.615890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.616958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.617924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.618937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.619854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:09:17.620384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:09:17.620457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:09:17.639089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.639266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.639354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.639454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.639535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.639678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.647998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.648118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.677036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.677272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.677418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.677522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.818975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.819159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.867513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.867750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.868222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.868462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.931950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.932585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.957398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.957634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.957746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.957863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.957947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.958893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.959013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.970296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.970625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.983945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:17.984587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:09:18.002037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.002272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:09:18.002510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.002598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.002722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:09:18.002807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:09:18.003053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:09:18.003344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.003856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.004030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.004283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.015922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.016108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.016389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.024116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.024605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.027401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.027681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.027869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.027952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.028995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.029077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.029296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.029872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.030904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.031168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.056856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.057683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.058485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.058764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.059323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.059603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.064024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.064304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.064704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.064803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.065080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.065472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.072128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.072355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.072707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.072988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.077357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.077647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.077931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.078238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.078900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.079830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.098419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.098701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.098842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.099024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.103407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.103917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.107041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.107338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.107546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.107840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.112462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.112898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.116074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.116487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.119711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.120870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.121018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.121155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.121283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.121478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.140935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.141216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.141369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.141510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.141640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.141768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.141896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.142062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.149584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.149899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.151330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.151608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.151740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.151911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.155540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.155718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.155847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.155996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.156812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.169773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.169927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.170103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.170923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.171049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.172598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.172748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.172873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.172998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.190563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.190719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.193805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.194042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.197094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.197227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.198835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.198978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.200471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.200600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.200755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.200892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.201032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.201657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.208797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.208965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.210446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.210621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.213614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.213749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.213905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.214031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.214322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.214456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.214605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.214733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.223719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.223883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.224012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.224176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.224311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.224443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.232057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.232228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:09:18.232843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.232971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.233980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.234961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.235913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.236043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.236250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.236383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:09:18.274221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561a227579c0 pid: 80330 (default app) Jul 04 09:09:18.274731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561a227579c0 pid: 80331 (default app) Jul 04 09:09:18.277619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eccac-b27a-41e9-8a22-77622d058c22 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:18.277907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eccac-b27a-41e9-8a22-77622d058c22 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:18.278215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eccac-b27a-41e9-8a22-77622d058c22 None None] PATH_INFO: `/v3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:18.282941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Mon Jul 4 09:09:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:27.025773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:27.026376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:27.026376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:27.031371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:27.036767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:27.037189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:27.037336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:27.106996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: INFO dbcounter [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] Registered counter for database keystone Jul 04 09:09:27.128443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:09:27.134676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:09:27.319914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80330) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:09:27.320255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80330) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:09:27.374842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:27.376474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:27.499427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:09:27.672435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:27.741682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: INFO dbcounter [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] Registered counter for database keystone Jul 04 09:09:27.761977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG oslo_db.sqlalchemy.engines [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:09:27.768199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writer thread running {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:09:27.887599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ce108-df99-48c7-9678-84b31d69e84d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:27.891914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:27.892574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:27.892863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:27.893146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:27.901657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:27.956122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:09:27.956542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c883-9c3c-4c17-8860-d38ee5fee413 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:27.966622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Mon Jul 4 09:09:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:09:27.972688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:27.987587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24fe46-3ea1-4ed8-8926-c2ea178bdf57 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:27.991954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:27.993075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:27.993365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:27.993644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] PATH_INFO: `/v3/projects/b76267d843014c29925a4e096c435d8d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:27.997983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b76267d843014c29925a4e096c435d8d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:28.048879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:09:28.049451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9591fd-372c-412d-8929-1b79a0758fd1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:28.053791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Mon Jul 4 09:09:27 2022] GET /identity/v3/projects/b76267d843014c29925a4e096c435d8d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:30.062687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c480-b2b4-4aea-b4cb-6777ec0de06e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:30.063193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c480-b2b4-4aea-b4cb-6777ec0de06e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:30.063274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c480-b2b4-4aea-b4cb-6777ec0de06e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:30.067416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:30.072783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:30.073193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:30.073349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:30.092230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:30.094416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:30.102234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:09:30.124575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1c480-b2b4-4aea-b4cb-6777ec0de06e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:30.136429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1c480-b2b4-4aea-b4cb-6777ec0de06e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:30.141099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:30.141731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:30.142016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:30.142350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:30.149945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:30.151738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea917ef-5eb7-4236-b521-29ded0fa8dda admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:30.161110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Mon Jul 4 09:09:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:09:30.166675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:30.175705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780452e6-0710-4ea8-9630-d7fc8b61c720 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:30.180169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:30.181037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:30.181323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:30.181602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:30.183021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:30.184853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f84b8-2ce6-4e6b-ac20-578a14e7f1f2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:30.186449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Mon Jul 4 09:09:30 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:32.281937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22680e8e-97c1-4bd6-9de0-14c2d113aecf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.282500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22680e8e-97c1-4bd6-9de0-14c2d113aecf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.282500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22680e8e-97c1-4bd6-9de0-14c2d113aecf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.283918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:09:32.289173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.289569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.289730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.307071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:32.308246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:32.313433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207722d-32a5-4bce-a3fe-5ee497cdb268 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.313732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207722d-32a5-4bce-a3fe-5ee497cdb268 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.314020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207722d-32a5-4bce-a3fe-5ee497cdb268 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.315421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:09:32.320777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.321075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.321363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.362586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80331) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:09:32.363003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80331) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:09:32.392756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:32.409403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:32.411057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:32.416587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.441294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:32.515856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:32.523654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1508e1-1bc2-41d9-ae3b-e2a1e0e81555 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:32.537482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.556179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:32.556977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.557262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.557545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.569180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:32.581981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:32.583164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:32.584155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:09:32.588919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.642332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aac965-1a37-47bf-9fb7-07492863ee73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:32.647578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:32.677384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:32.685569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:32.688919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.688919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.688919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.697567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988256-644c-4ff0-a813-b475b019f956 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:32.741186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:32.741919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.742251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.742519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.743321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:32.743636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:32.745106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:32.759731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:32.765701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:32.765918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.767318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:32.870496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:09:32.874830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415b41-2235-41c4-b8d8-d5ed957e9860 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:32.876959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.879808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:32.909074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:32.909953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:32.910265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:32.910551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:32.911793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:32.913260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:32.914918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:32.920788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:32.935373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:32.975362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53e30d-c50b-4a40-b2ab-6e71e3ea37e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:33.013536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:33.014425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:33.014715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:33.014991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:33.025044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98ee8-c25d-4be2-915d-4d13e03fd024 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:33.034938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:33.036428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:09:33.057560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:33.058668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:33.059731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:09:33.059731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:09:33.059731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:09:33.059731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:33.059731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:09:33.065263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:33.065406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:33.066089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:33.066445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:33.066749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:33.068127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:33.069625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:33.071280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:33.076991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:33.124449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:33.159560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:33.171891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec5ed-7b00-4c9f-a4e3-54641153f881 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:33.177952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1e6c-91dd-484e-b518-bae72b836bca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:33.205578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:33.206269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:33.206566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:33.206852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:33.207580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:33.207893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:33.209300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12761d95-124c-4368-b8d9-e688da0f7dce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:33.215881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:33.216545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:33.216830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:33.217139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:33.217970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.domain.id=default, user.id=4e3cc86167294f7c9616a6b3d1573df4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:33.218316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:33.219759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b0dcf-a20e-489d-a9b2-8404ff8af409 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:33.227315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Mon Jul 4 09:09:33 2022] GET /identity/v3/role_assignments?user.id=4e3cc86167294f7c9616a6b3d1573df4&scope.domain.id=default&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:33.235116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:35.425269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521621-1ed0-4bdc-8d75-5277d41102a8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:35.425793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521621-1ed0-4bdc-8d75-5277d41102a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:35.425873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521621-1ed0-4bdc-8d75-5277d41102a8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:35.427511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:35.433094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9890aa0-6c5b-48cf-855b-9cb9a9e7263a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:35.433500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9890aa0-6c5b-48cf-855b-9cb9a9e7263a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:35.433688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9890aa0-6c5b-48cf-855b-9cb9a9e7263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:35.455197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9890aa0-6c5b-48cf-855b-9cb9a9e7263a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:35.456394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9890aa0-6c5b-48cf-855b-9cb9a9e7263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:35.544567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:35.572938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521621-1ed0-4bdc-8d75-5277d41102a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:35.652376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b475c9-8fe1-4238-8327-e54808f2182d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:35.652686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b475c9-8fe1-4238-8327-e54808f2182d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:35.652937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b475c9-8fe1-4238-8327-e54808f2182d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:35.654687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:35.661673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:35.661673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:35.661673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:35.679784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:35.681308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:35.741745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:35.755722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521621-1ed0-4bdc-8d75-5277d41102a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:35.786087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:35.827934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:35.867501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:35.868393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:35.868684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:35.868967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:35.895459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:35.908830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:35.909717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:35.910492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 13/26] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:35.919200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:35.934543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:36.056898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053cbc4-7b7f-4204-91ea-f6da194167b9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.076598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc3a5-98f6-4d36-b26e-f533ac39a793 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.120035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.121072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.121502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.121924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.123163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:36.124142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.125699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2c92-d46a-4139-9edf-2626f92e53eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.140152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 14/27] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:36.143390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244ecb-926a-4a4f-8fd0-facca350f76e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.145028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244ecb-926a-4a4f-8fd0-facca350f76e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.146170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244ecb-926a-4a4f-8fd0-facca350f76e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.148237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 15/28] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:36.150285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59244ecb-926a-4a4f-8fd0-facca350f76e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:36.155998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.156988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.157421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.157865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.190307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.191823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f3aac20a-7be6-4260-86b3-4bb757f0b641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:09:36.217763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:36.218876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:36.219820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:09:36.219820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:09:36.219820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:09:36.219820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:36.222347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 14/29] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:36.223725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.228652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.229787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.266102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:36.269573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:36.302786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:36.322540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:36.361268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59244ecb-926a-4a4f-8fd0-facca350f76e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.413306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:36.416183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:36.432467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.433938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.436630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.437068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.438498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.441636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.444371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 16/31] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:36 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:36.450788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:36.551372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff58c2d-00fe-4f91-8d22-3b23d84940e1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.576130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55d25-45a9-4ac1-b998-839237e1aa45 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.588421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.589319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.589843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.590275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.591254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:36.591783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.593887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.606979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 16/32] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:36.608784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:36.619748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.620815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.621280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.621720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.623451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.625570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289f89b-55f0-477d-a03e-54e9d0d3eac7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.628087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 17/33] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:36.629820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207d7f-ec1b-458f-b49f-8c891abf52f3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.630326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207d7f-ec1b-458f-b49f-8c891abf52f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.630889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207d7f-ec1b-458f-b49f-8c891abf52f3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.632779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 18/34] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:36.633787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207d7f-ec1b-458f-b49f-8c891abf52f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:36.641903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:36.645358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:36.756322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7857f-5967-40a5-8cac-7796960956d0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.761299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207d7f-ec1b-458f-b49f-8c891abf52f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:36.794296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.795500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.795794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.796162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.796985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.798424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:36.807036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:36.807792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:36.808147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:36.808497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:36.809290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:36.811473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885f9f-86d1-4353-859e-ce16e737b6a1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:37.037443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 17/35] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Jul 4 09:09:36 2022] POST /identity/v3/roles => generated 219 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:37.038914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:37.061435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 19/36] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:09:36 2022] POST /identity/v3/projects => generated 301 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:37.063356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb4e2-b498-4463-80e4-ff4dccf6af51 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.064015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb4e2-b498-4463-80e4-ff4dccf6af51 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.065327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb4e2-b498-4463-80e4-ff4dccf6af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.087479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-14efb4e2-b498-4463-80e4-ff4dccf6af51 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:37.089493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-14efb4e2-b498-4463-80e4-ff4dccf6af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:37.155652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:37.166643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:37.186626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:37.188469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3fdd-a66b-4ef6-b09b-ec16206c35fe None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.188772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3fdd-a66b-4ef6-b09b-ec16206c35fe None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.189183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3fdd-a66b-4ef6-b09b-ec16206c35fe None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.195180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 21/38] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:37.196542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f659f50-4d34-425b-9680-fe7c3e47a320 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.196732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f659f50-4d34-425b-9680-fe7c3e47a320 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.197129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f659f50-4d34-425b-9680-fe7c3e47a320 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.197722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4b32-0ae5-4e41-bb0f-4c221c1862c5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:37.200996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 22/39] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:37.205209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c5c4-1335-4072-913a-f21b191f14c4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.205209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c5c4-1335-4072-913a-f21b191f14c4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.205209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c5c4-1335-4072-913a-f21b191f14c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.235478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9591c5c4-1335-4072-913a-f21b191f14c4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:37.236692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9591c5c4-1335-4072-913a-f21b191f14c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:37.264791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:37.274941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.274941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.274941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] PATH_INFO: `/v3/domains/default/users/4e3cc86167294f7c9616a6b3d1573df4/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.274941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4e3cc86167294f7c9616a6b3d1573df4, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:37.274941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:37.318438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 23/40] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:37.319617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.319911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.320194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.337242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:37.343815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:37.405301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 24/41] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:37.406140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:37.421018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 18/42] 10.222.0.61 () {58 vars in 1361 bytes} [Mon Jul 4 09:09:37 2022] PUT /identity/v3/domains/default/users/4e3cc86167294f7c9616a6b3d1573df4/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:09:37.421796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:37.546020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5eaa-06b2-4a10-b71c-89b283430e70 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:37.586907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:37.593336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86088908-1df7-401e-b536-240489d12a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:37.594127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088908-1df7-401e-b536-240489d12a7d None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.594567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088908-1df7-401e-b536-240489d12a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.601610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86088908-1df7-401e-b536-240489d12a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.601610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86088908-1df7-401e-b536-240489d12a7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:37.601610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86088908-1df7-401e-b536-240489d12a7d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:37.648713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dd70d-e1d2-46e9-b3ef-82f00df5fc0b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:37.683167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:37.683920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.684088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:37.684194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.684485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.685250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:37.686904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:37.691150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 19/43] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:37.695350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86088908-1df7-401e-b536-240489d12a7d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:37.788456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 25/44] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/roles => generated 225 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:37.827284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86088908-1df7-401e-b536-240489d12a7d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:37.868333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:37.869078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:37.869367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:37.869649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:37.871808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:37.874177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605535-2813-4a43-aa55-815206baebb8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:37.875975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 20/45] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:37.881837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:37.999802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5549-08dd-4223-98b6-2e9caf450522 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:38.002704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:38.036107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:38.037095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:38.037560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:38.038016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:38.039209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:38.040689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca647a6d-0f69-49c5-af9b-a8191251dd1a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:38.136230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 26/46] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:09:37 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:39.479832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e318e-dc1e-4367-811c-8035e2e8faec None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:39.480335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e318e-dc1e-4367-811c-8035e2e8faec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:39.480335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e318e-dc1e-4367-811c-8035e2e8faec None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:39.481685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 21/47] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:39.487018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:39.487421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:39.487614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:39.505049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:39.506297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:39.574637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 27/48] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:39.598605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e318e-dc1e-4367-811c-8035e2e8faec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:39.666261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:39.703227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e318e-dc1e-4367-811c-8035e2e8faec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:39.736573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:39.737296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:39.737611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:39.737879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:39.750617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:39.759496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:39.760395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:39.761380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 22/49] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:39.766805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:39.849088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:39.864176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421fec-a147-4f2b-afdc-9d646da93986 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:39.899020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:39.899703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:39.899997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:39.900285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:39.901045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:39.901360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:39.902785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:39.910948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 28/50] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:39.916489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.019237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4ed4d-b63a-4769-b252-0b00f6983bd4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:40.044625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:40.053222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:40.054093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.054405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.054683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.055901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:40.057372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912424d-d09b-4459-aae9-43bc2455c9b5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:40.059032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 23/51] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:39 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:40.064575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.165924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91bb0-48b7-43f6-867b-cf07381c32b1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.166262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91bb0-48b7-43f6-867b-cf07381c32b1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.166483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799661b-9653-4a43-8b0c-ed16872a55c4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:40.166587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91bb0-48b7-43f6-867b-cf07381c32b1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.167914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 24/52] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:09:40.173494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.173790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.174078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.190702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:40.192235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:40.201000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:40.201805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.202098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.202415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.203625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:40.205082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:40.207492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 29/53] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:40.212392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.231526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:40.261254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 25/54] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:40.285215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.314413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4bcc9-0141-490e-bf21-d3bef4a58574 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:40.348687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:40.349354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.349648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.349933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.350804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.domain.id=default, user.id=4e3cc86167294f7c9616a6b3d1573df4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:40.351403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:40.352585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:40.359149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 30/55] 10.222.0.61 () {56 vars in 1322 bytes} [Mon Jul 4 09:09:40 2022] GET /identity/v3/role_assignments?user.id=4e3cc86167294f7c9616a6b3d1573df4&scope.domain.id=default&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:40.388193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c3f8e-42dd-4dfb-9713-5791c9489aff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:40.417005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:40.428284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:40.429175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.429464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.429745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.431129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:40.432635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765eb4b-40be-4a2e-9ee2-3162845c3ca7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:40.434580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 26/56] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:40.440208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:40.526118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:40.548784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc2663-f909-45ea-a244-6c2b0a5c916f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:40.580129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:40.580799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:40.581087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:40.581370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:40.582096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:40.583583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee176bb-4d75-4330-9dec-705f9f8f96c6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:40.678471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 31/57] 10.222.0.61 () {60 vars in 1140 bytes} [Mon Jul 4 09:09:40 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:42.685713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1ef0-716c-4a04-8083-df39f929b47a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:42.686241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1ef0-716c-4a04-8083-df39f929b47a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:42.686241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1ef0-716c-4a04-8083-df39f929b47a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:42.687594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 27/58] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:42.692796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:42.693190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:42.693366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:42.710364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:42.711584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:42.776319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 32/59] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:42.801150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e1ef0-716c-4a04-8083-df39f929b47a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:43.008575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e1ef0-716c-4a04-8083-df39f929b47a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:43.043159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:43.043958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:43.044245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:43.044527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:43.045709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:43.047201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5d734-6648-47fb-85b7-48909e70f82a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:43.048819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 28/60] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:43.054367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:43.113074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:43.151186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e30ad-824c-4895-aac0-19ddf8045670 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:43.186039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:43.186743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:43.187035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:43.187311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:43.188019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:43.189469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bccc6-7c8c-46d0-a67b-079d66f790a4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:43.294458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 33/61] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:09:43 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:46.484572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c3ce-c737-428d-b23b-ead69ade426b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.485404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c3ce-c737-428d-b23b-ead69ade426b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.485859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c3ce-c737-428d-b23b-ead69ade426b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.487468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 29/62] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:46.492946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.493845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.494303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.518789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:46.521393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91b18-e72b-46d4-b088-469c00041466 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.521839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91b18-e72b-46d4-b088-469c00041466 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.522320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a91b18-e72b-46d4-b088-469c00041466 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.523840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 30/63] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:46.524436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:46.531646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.532227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.532753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.561632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:46.563215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:46.645826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 34/64] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:46.658550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:46.667682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 31/65] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:46.669151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:46.694795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:46.766368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:46.827337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792df22-cf8e-44eb-8b13-c01ae29bce08 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:46.829664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597d08-02a2-41d0-a243-aad06d2d4687 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:46.869750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:46.870063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:46.870591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.870873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.871154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.871696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.872461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.872918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.882865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:46.884369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a7951f1e-69a9-461d-b255-5de12638ed6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:46.890723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:46.891599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:46.892363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 35/66] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:46.893423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83b56-977e-4939-826d-344c87b7c47b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.893913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83b56-977e-4939-826d-344c87b7c47b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.894388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83b56-977e-4939-826d-344c87b7c47b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5d728cc5-3450-4b24-a051-5565ac5771ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:46.895700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:46.896610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:46.897386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:46.897977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 36/67] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:46.899377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 32/68] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:09:46.904749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83b56-977e-4939-826d-344c87b7c47b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:46.907179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:46.907711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:46.908198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:46.927162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:46.928383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:46.984457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.006074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 33/69] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:47.006979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.022497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83b56-977e-4939-826d-344c87b7c47b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.035357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.062070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.062788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.063076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.063356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.064112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:47.064573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.066097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6e826-3a1a-44fe-be41-6613b0d34e4f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.075575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 37/70] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.077384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70e29-3830-48fe-aa03-52e4f5d7bedf None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.077685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70e29-3830-48fe-aa03-52e4f5d7bedf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.077973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70e29-3830-48fe-aa03-52e4f5d7bedf None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.079487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 38/71] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:47.083364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70e29-3830-48fe-aa03-52e4f5d7bedf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.125128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68dabe-27ee-4e95-ac08-c79658e5e25a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.160266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.160942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.161309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.161590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.162390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:47.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.164106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.176488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 34/72] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.177497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.191630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70e29-3830-48fe-aa03-52e4f5d7bedf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.222173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.229151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.229553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.229836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.230117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.240592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-482bd7c1-a837-4221-a919-157bce0c9e6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:47.249070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:47.250143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:47.251127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 39/73] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:47.253199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.253495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.253779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.270691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:47.271903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:47.279519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbdda-3b3c-4fef-9659-c4e07b4c08b6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.295571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.312885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.313772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.314068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.314379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.315670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.317151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea67b-9085-45f6-9d25-309f77d1145f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.318832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 35/74] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.320022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa42c9d-4822-4b04-8142-c7bf58e3f495 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.320314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa42c9d-4822-4b04-8142-c7bf58e3f495 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.320598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa42c9d-4822-4b04-8142-c7bf58e3f495 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.321839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 36/75] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:47.322576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa42c9d-4822-4b04-8142-c7bf58e3f495 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.343332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 40/76] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:47.344198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.430510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa42c9d-4822-4b04-8142-c7bf58e3f495 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.441117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.449555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039afe17-ed0f-4489-ac64-6c75d6162909 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.465495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.466933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.467220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.467505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.482828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.484574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.484674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.485301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.485588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.485917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.486643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 37/77] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.487088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:47.487088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.487435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.488341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0e47-edf2-486c-8e73-4adf237bde54 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.501851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 41/78] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.501851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.501851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.501851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.516326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:47.517532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:47.534018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.584316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 42/79] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:47.585165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.589632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e27-8a68-44d1-ad8c-aa8129843979 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.624329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.624991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.625283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.625568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.661537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.693625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0cc0-1199-4488-8bc3-4c1af75337c1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.694921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.696418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.728271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.729078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.729371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.729658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.739864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:47.748526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:47.749899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:47.750709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:47.753980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 43/80] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:47.759203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.775077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.803365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 38/81] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:47.803365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.860981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3e25-b5b3-4ab3-a411-3646793538cf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.867418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:47.894300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.894949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.895240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.895524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.900116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b477b38-c49f-479e-82ee-0afa314755db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:47.934797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:47.936189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:47.936472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:47.936748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:47.937953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.939442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.941220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 39/82] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:47.941806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:47.967090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:47.968625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:47.982860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.041325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6221-2ee1-44ad-8e21-95b44a23ee32 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.068593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 44/83] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:48.069379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.077979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.078881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.079172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.079459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.080676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.082139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.088222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 40/84] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.088222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.088222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.174265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e759-9cff-4df1-a3c5-e34b9dec0eea None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.184243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cb73-e45e-4740-b303-95bd7858bb1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.187661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.208852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.209527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.209818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.210098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.210885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:48.211237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.212716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.218488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.219368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.219662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.219944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.221316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 45/85] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.221498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.222952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.223151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.227213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 41/86] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.227213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.298005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.326620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a156-2f63-497b-8999-3625010cbdd6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.330891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239de82-89ee-4324-ad81-0e95c0dfe0d7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.361655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.362563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.362857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.363144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.364353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.365571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.365834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.366251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.366550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.366837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.367569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 42/87] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.368318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.414441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.439310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.440816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.466851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98689d19-1d3a-4163-ab2e-9017a29ddd62 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.503675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.504459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.504668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.504959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.505683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.507176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.522421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.540431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 46/88] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:48.541282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.613479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.626026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 43/89] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:09:48 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:48.628996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.639656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049e53-2328-4c6d-8ace-3a632d41ce4a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.677486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.678434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.678731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.679020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.680389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.682002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.685426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 47/90] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.686236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.767550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca54f-aaa5-4f01-bb23-b814afb576dc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.807706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.808383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.808679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.808968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.809096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36890bfa-9578-4663-a4b3-efd46a3be5e4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:48.809849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=4e3cc86167294f7c9616a6b3d1573df4) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:48.810172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.811676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.819837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 44/91] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/role_assignments?user.id=4e3cc86167294f7c9616a6b3d1573df4&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.820645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.864643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:48.865600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:48.866059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:48.866380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:48.867305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:48.867630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:48.869120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:48.880486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 48/92] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:48.881776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:48.892800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.907988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:48.983106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3476c-e177-48b9-bcf5-d2d854034896 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:49.034071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f227-c1f4-4f5f-a108-31cf037eb4d0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:49.040557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:49.041805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:49.042273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:49.042695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:49.044354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:49.046121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:49.048355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 45/93] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:49.055778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:49.083581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:49.084256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:49.084545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:49.084825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:49.170952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:49.172383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:49.185339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:49.199418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec851-3f4d-4ace-97b7-b22d96a3a288 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:49.229663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:49.238818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:49.239712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:49.240032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:49.240474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:49.241443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:49.241967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:49.243651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:49.250587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 46/94] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:49 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:49.294259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 49/95] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:49.307403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:49.445192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c6dfd-75c9-4a22-85e7-48cf11ac323f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:49.484647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:49.485531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:49.485817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:49.486096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] PATH_INFO: `/v3/projects/840e3641fbfc4ff5b6af389b180e95e8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:49.487389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] RBAC: Authorizing `identity:get_project(project_id=840e3641fbfc4ff5b6af389b180e95e8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:49.488886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b8a93-26fe-473d-8000-8d3b11671d77 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:49.490738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 47/96] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:49 2022] GET /identity/v3/projects/840e3641fbfc4ff5b6af389b180e95e8 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:49.496939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:49.613487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44bfe8-501b-4f28-9673-0397baf0c0a7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:49.621893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:49.651339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:49.652005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:49.652293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:49.652576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:49.654090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=840e3641fbfc4ff5b6af389b180e95e8, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:49.654529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:49.655999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96603e7-0b83-4b73-b5fb-439b3a3e71d2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:49.662357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 50/97] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:49 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=840e3641fbfc4ff5b6af389b180e95e8&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:51.424797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4377c-a9a2-45ae-8c50-e09fc0f8c1d8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.425908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4377c-a9a2-45ae-8c50-e09fc0f8c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.426426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4377c-a9a2-45ae-8c50-e09fc0f8c1d8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.428395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 48/98] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:51.433370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811528-8b51-4681-a208-f15dc6145946 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.434218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811528-8b51-4681-a208-f15dc6145946 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.434727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811528-8b51-4681-a208-f15dc6145946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.453833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-07811528-8b51-4681-a208-f15dc6145946 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:51.455378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-07811528-8b51-4681-a208-f15dc6145946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:51.529928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 51/99] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:51.567157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4377c-a9a2-45ae-8c50-e09fc0f8c1d8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:51.638351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:51.689143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4377c-a9a2-45ae-8c50-e09fc0f8c1d8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:51.730077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:51.730327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d295-a414-4769-81ed-093c619a1c46 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.730563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d295-a414-4769-81ed-093c619a1c46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.730801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d295-a414-4769-81ed-093c619a1c46 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.731841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.732374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 52/100] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:09:51.732764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.733236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.745910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cff869-700f-412a-bcfc-797b3507c657 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.746538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cff869-700f-412a-bcfc-797b3507c657 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.747581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cff869-700f-412a-bcfc-797b3507c657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.747984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:51.755796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:51.756661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:51.757626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 49/101] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:51.763158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:51.795439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f4cff869-700f-412a-bcfc-797b3507c657 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:51.796960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4cff869-700f-412a-bcfc-797b3507c657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:51.883999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f5cf-e53a-485d-b0eb-20241c9f2a31 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:51.885376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 53/102] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:51.886865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df17c-3a54-4b4b-9ef1-e90a891590b9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.887165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df17c-3a54-4b4b-9ef1-e90a891590b9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.887452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df17c-3a54-4b4b-9ef1-e90a891590b9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.889284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 54/103] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:51.894778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.895142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.895493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.906737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:51.918169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:51.919455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:51.930082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:51.930082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:51.930082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:51.930082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:51.930436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:51.930436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:51.930436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:51.934711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 50/104] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:51.935352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:51.949034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:51.999841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 55/105] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:52.000485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.070549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a9bc-de7b-47c8-80b5-423ad96be046 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.112115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.112923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.113208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.113489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.129096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:52.138778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:52.139650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:52.140414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 51/106] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:52.141051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.149105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213c5a9-166f-40d4-8fb8-4e8ddefffb07 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.188603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.207551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.208691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.209310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.209841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] PATH_INFO: `/v3/users/ce700726e09c400a86df26df099e8325` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.244280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] RBAC: Authorizing `identity:get_user(user_id=ce700726e09c400a86df26df099e8325)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.245896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.248680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 56/107] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:51 2022] GET /identity/v3/users/ce700726e09c400a86df26df099e8325 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.249569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.253146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb162-1f84-4314-8b54-b020b3cc541e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.276225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.291020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.291964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.292349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.292727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.303791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:52.312520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:52.313399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:52.315293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 52/108] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:52.316666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.365669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2285a-a12f-47db-bf88-ee9651d311f8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.404291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.405079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.405373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.405660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.406448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:52.406763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.408261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f00bc-5688-4246-8231-17774a85e85b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.417671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 57/109] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.420536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049c7f-698a-4d3b-9407-64bc55557b5a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.423286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.425279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f283-cf74-4d78-a4cd-9f5e30f0567e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.425572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f283-cf74-4d78-a4cd-9f5e30f0567e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.425858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f283-cf74-4d78-a4cd-9f5e30f0567e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.427612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 58/110] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:52.429567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94f283-cf74-4d78-a4cd-9f5e30f0567e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.459938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.460856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.461423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.462028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.532322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.554645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94f283-cf74-4d78-a4cd-9f5e30f0567e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.556254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.558737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce210d-f915-4ee7-bea0-28b581079a42 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.593518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.594730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.595173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.595602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.596809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:52.597283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.598922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.609061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 59/111] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.610408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.687288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 53/112] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:52.689030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.689474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.689904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.695488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.708615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:52.710139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:52.732328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446cd9-2044-494c-9b9d-7fd3297b21cc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.776273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.777150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.777440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.777721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.779464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.780912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.782569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 60/113] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.783333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.788130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 54/114] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:52.789219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.808373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.900467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6bf9-1f26-4fc0-8b11-05b5b8ac921a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.902911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fa6ac-c60e-424e-a5b3-5a6b89f57c1e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:52.932140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:52.937525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.938443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.938729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.939023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.940180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:52.940320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.941073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.941368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.941667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.941765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cb6c0-26f5-4b1a-98ed-4fbb4a4a1424 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.942894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:52.948185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 55/115] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.948303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:52.948381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef954-d21e-47f0-bff9-938335e6fccc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:52.948381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef954-d21e-47f0-bff9-938335e6fccc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:52.948381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef954-d21e-47f0-bff9-938335e6fccc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:52.948571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 61/116] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:52.948571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:52.951267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 56/117] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:52.952100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef954-d21e-47f0-bff9-938335e6fccc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.037117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.058735 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeec9b-d030-4e05-aa5e-58859aaf3b8b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.066239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef954-d21e-47f0-bff9-938335e6fccc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.093783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.094681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.094966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.095250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.096464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.097968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.099891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 62/118] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:53.100450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.100564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.101425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.101720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.101998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.103407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.104939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.111596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 57/119] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:53.111596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.175005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.202660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c81a9-5379-483c-a6cc-09187ce13ce0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.207442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a52f-1a2b-4e2a-a027-dd6819ef0acc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.238466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.239140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.239455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.239749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.240595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=ce700726e09c400a86df26df099e8325) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:53.240913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.242407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200c6af-4e74-4165-ae69-92d87086ecd4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.243649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.244514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.244803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.245081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.246323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.248054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce69834-9a6f-4cf8-a24d-f8cc5577b52c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.248563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 63/120] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:53 2022] GET /identity/v3/role_assignments?user.id=ce700726e09c400a86df26df099e8325&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:53.254898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 58/121] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:53 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:53.255102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.255102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.255102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.255340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41334-106d-45eb-ba5d-9c637bdf03d6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.255340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41334-106d-45eb-ba5d-9c637bdf03d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.255340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f41334-106d-45eb-ba5d-9c637bdf03d6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.255340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 59/122] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:53.255340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f41334-106d-45eb-ba5d-9c637bdf03d6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.278868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:53.280140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:53.283549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.359265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 64/123] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:53.360175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.402501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f41334-106d-45eb-ba5d-9c637bdf03d6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.440020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.440945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.441231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.441510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/e0e490f204044da49e3dfa0e62de8224/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.443544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, user_id=e0e490f204044da49e3dfa0e62de8224, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.445006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.448227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.471370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5b9c-8d31-4d49-a8d0-e25b79559740 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.506269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.509052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.509052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.509052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.509052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.509665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178edaef-b818-4eb3-bc2d-4a82a49ba862 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.520755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.545435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 60/124] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:09:53 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/e0e490f204044da49e3dfa0e62de8224/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:09:53.546343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.646738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 65/125] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:09:53 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:53.648468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.648771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.649055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.671669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349acf-1497-457e-a178-f35cc72f30b4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.682008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:53.683287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:53.719604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:53.720878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:53.721350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:53.721876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/4e3cc86167294f7c9616a6b3d1573df4/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:53.727831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, user_id=4e3cc86167294f7c9616a6b3d1573df4, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:53.729859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:53.791546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 66/126] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:53.792448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.837657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 61/127] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:09:53 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/4e3cc86167294f7c9616a6b3d1573df4/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:09:53.838576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:53.927450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:53.954147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872af59-9353-4d1c-9989-bbe97bbb54fb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:53.986671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.002056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.003267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.004061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.005555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.028575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:54.040105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:54.041064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:54.041925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:54.051219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 67/128] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:09:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:54.051418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ee3c-3b71-4741-b594-b678c36ff2d4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.057069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.100165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.100999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.101490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.101752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.116886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:54.128566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:54.129602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:54.130445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:54.131053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 62/129] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:54.136843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.204014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0d2b-98a1-43da-ad65-ff58278bbbb1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.240189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.240812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.241109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.241396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.242159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:54.242506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.243918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.255106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237765-a120-456b-aba7-3cd263cffd36 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.258012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 68/130] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:54.259288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.273106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.292590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.293380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.293677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.294566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.295326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:54.295641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.297060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.306854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 63/131] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:54.308073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.312487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.374865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84532-cd69-4500-932f-2df36b47bff0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.410713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.411586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.411878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.412161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.413406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.414910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.416729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 69/132] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:54.422822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.423842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37912a-737f-4e54-bb1b-2c48cb29455d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.459709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.460656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.460944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.461280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.462671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.464143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.466409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 64/133] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:54.472349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.524445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.530506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e38109-4a70-48f1-8761-e8d835f897ff None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.544947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.566890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.567774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.568066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.568352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.569590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.571106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.573069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 70/134] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:54.579198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.585109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3f38-602f-49ac-8858-78e59c653746 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.622425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.623303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.623594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.623880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] PATH_INFO: `/v3/projects/840e3641fbfc4ff5b6af389b180e95e8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.631051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] RBAC: Authorizing `identity:get_project(project_id=840e3641fbfc4ff5b6af389b180e95e8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.632548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.634368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 65/135] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:54 2022] GET /identity/v3/projects/840e3641fbfc4ff5b6af389b180e95e8 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:09:54.644001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:54.688603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af653a-9d45-4242-ae21-194836ca0313 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.727751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.728702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.729000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.729289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/e0e490f204044da49e3dfa0e62de8224/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.736021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, user_id=e0e490f204044da49e3dfa0e62de8224, role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.737509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dad5c-648e-49a2-95f4-f18dfa353b01 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.797504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 71/136] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:09:54 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/e0e490f204044da49e3dfa0e62de8224/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:09:54.825460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88d4-4171-4afd-8b13-c5775f6b3b5f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:54.848279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:54.877990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:54.879193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:54.879488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:54.879778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] PATH_INFO: `/v3/projects/840e3641fbfc4ff5b6af389b180e95e8/users/e0e490f204044da49e3dfa0e62de8224/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:54.881922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] RBAC: Authorizing `identity:create_grant(project_id=840e3641fbfc4ff5b6af389b180e95e8, user_id=e0e490f204044da49e3dfa0e62de8224, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:54.883542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95387e0-b229-42b2-9d22-459c79882bac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:54.963054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 66/137] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:09:54 2022] PUT /identity/v3/projects/840e3641fbfc4ff5b6af389b180e95e8/users/e0e490f204044da49e3dfa0e62de8224/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:09:56.444340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d612-f1f6-4ed7-8839-ca1039541b4c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.445680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d612-f1f6-4ed7-8839-ca1039541b4c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.445680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d612-f1f6-4ed7-8839-ca1039541b4c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.446608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 72/138] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:56.452382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.452794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.452982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.474809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986e21-1993-478a-90ad-c959f4c801c9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.475127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986e21-1993-478a-90ad-c959f4c801c9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.475386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986e21-1993-478a-90ad-c959f4c801c9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.476766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 73/139] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:09:56.478239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:56.479524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:56.482223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.482533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.482819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.508716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:56.509920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:56.578367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:56.621645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 67/140] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:56.640543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 74/141] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:09:56.658027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:56.681028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:56.821433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280453-45a9-43ad-9ee8-55fcaa386bcc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:56.826601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:56.863055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:56.864252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.864746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.865305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.878105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0214e754-3d95-4d80-93d0-8f8f354ae6be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:56.886878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:56.888694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:09:56.889457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:09:56.891822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 68/142] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:56.893486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c8db-72e3-429f-9bb4-2818905b1741 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.893971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c8db-72e3-429f-9bb4-2818905b1741 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.894479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c8db-72e3-429f-9bb4-2818905b1741 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.896482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 69/143] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:56.901331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617c8db-72e3-429f-9bb4-2818905b1741 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:56.902512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18939dfa-4ed1-4c39-947d-51242fc12dae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:56.967035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:56.968089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.968266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.968590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:56.981227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a6bef654-adad-435a-a210-05a5ba17ef77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:56.989513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:56.990462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:56.991215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 75/144] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:09:56.992451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:56.992744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:56.993025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.010988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:57.012171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:57.026965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617c8db-72e3-429f-9bb4-2818905b1741 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.039218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.075837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.076511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.076798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.077084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.077838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:57.078153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.079620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac173-7dfd-487a-a8cc-9509160f2561 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.091923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 70/145] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.092973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 76/146] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:57.094112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.097102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf97b0-01a1-4f33-a2a2-1c8dcfa124c5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.097401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf97b0-01a1-4f33-a2a2-1c8dcfa124c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.097687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf97b0-01a1-4f33-a2a2-1c8dcfa124c5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.104626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 71/147] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:57.105351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf97b0-01a1-4f33-a2a2-1c8dcfa124c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.150481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.230688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724662f-7d4a-4f50-b880-c591eafadc18 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.242761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf97b0-01a1-4f33-a2a2-1c8dcfa124c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.281017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.282465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.283168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.283742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.284855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:57.285429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.287413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.287661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.288712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.289101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.289559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] PATH_INFO: `/v3/users/ce700726e09c400a86df26df099e8325` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.291011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] RBAC: Authorizing `identity:get_user(user_id=ce700726e09c400a86df26df099e8325)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.292733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f47870-1179-4d7c-b38a-a4703b386fce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.294777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 72/148] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/users/ce700726e09c400a86df26df099e8325 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.300726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.300726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.300726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.301012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 77/149] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.301012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.315915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:57.317216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:57.332229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.392950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 73/150] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:57.398757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.430995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a550-9622-4823-bb24-fe82f37ffbe6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.443103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.485171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.487214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.487652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.488356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.504466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:57.515296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:57.516331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:09:57.517436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:57.520658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 78/151] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:57.522370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.538550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296dd21-8422-40f9-aa17-9db905b49d5a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.579360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.580514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.580901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.581277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.582888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.584534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.586606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 74/152] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.587424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.638524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.657534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8dd8a-1617-4270-b457-7721aea26e58 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.693205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.694108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.694695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.694695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.695958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.697454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.699561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 79/153] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.700533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.713880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.724355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fab11-c434-4ede-b382-d9d3e371418a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.766518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.767483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.767780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.768067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.769236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.770772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.772537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 75/154] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.773278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.816823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367cb1-005b-4c1a-af29-471613dd101a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.854068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.854696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.854998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.855266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.856543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:57.856856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.858312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.867599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 80/155] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:57.868912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:57.886138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:57.889599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382190f-7f35-4c44-9d34-81726a222136 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:57.925598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:57.926558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:57.926848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:57.927132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/ce700726e09c400a86df26df099e8325/roles/2e82e576bfa04b87b8dabf163ab916c0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:57.929153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, user_id=ce700726e09c400a86df26df099e8325, role_id=2e82e576bfa04b87b8dabf163ab916c0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:57.930668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956db2-4e03-41ea-bed9-7cc0c13abc3d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:57.974265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d806c5-ed13-4144-b3fc-e99acbbe6b95 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.007864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 76/156] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:09:57 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/users/ce700726e09c400a86df26df099e8325/roles/2e82e576bfa04b87b8dabf163ab916c0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:09:58.008038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.008628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.008917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.009197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.009390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc024-713f-4cfd-bb7d-2317768ce840 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.009630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc024-713f-4cfd-bb7d-2317768ce840 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.009919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc024-713f-4cfd-bb7d-2317768ce840 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.011422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 77/157] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:58.012034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc024-713f-4cfd-bb7d-2317768ce840 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.037668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.104716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:58.107128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:58.124545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.132686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc024-713f-4cfd-bb7d-2317768ce840 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.175621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.176453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.176747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.177284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.177744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:58.179233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a51bfa-26e0-4fc6-8857-703b7d4c077d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:58.225385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 81/158] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:58.226372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.276749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 78/159] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:09:58 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:09:58.287970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df724a-25cb-4e99-871f-d8bed1c0858c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.288365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df724a-25cb-4e99-871f-d8bed1c0858c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.288774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df724a-25cb-4e99-871f-d8bed1c0858c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.290441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 79/160] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:09:58.291347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3674a1-69b8-4333-b3ea-e9144a58198f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.291532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3674a1-69b8-4333-b3ea-e9144a58198f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.291810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3674a1-69b8-4333-b3ea-e9144a58198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.324447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4c3674a1-69b8-4333-b3ea-e9144a58198f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:58.326642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4c3674a1-69b8-4333-b3ea-e9144a58198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:58.344051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7035-fdf1-46f4-af8b-431b774c8dde None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.361151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.385917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.386860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.387149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.387964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] PATH_INFO: `/v3/users/4e3cc86167294f7c9616a6b3d1573df4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.389256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] RBAC: Authorizing `identity:get_user(user_id=4e3cc86167294f7c9616a6b3d1573df4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:58.390823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:58.392544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 82/161] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/users/4e3cc86167294f7c9616a6b3d1573df4 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:58.393411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.431832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 80/162] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:58.433058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.433295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.433599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.445629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.453922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:09:58.455273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:09:58.537277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22fe1-3316-43e1-b3bc-141eada9da3f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.544388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 81/163] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:09:58.546434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.588702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.588702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.588702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.589095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.590070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:58.592144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:58.594103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 83/164] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:58.594674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.660937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.679394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b3c0-66d6-4f80-9818-c624f8127019 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.720018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.720975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.721271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.721594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.725486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375d07-b48b-4b67-a82d-0e11202d99a2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.726530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.777989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.779384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.779673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.779958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:58.794725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:58.805808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:58.806775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:58.807548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 84/165] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:58.808425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.813285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:58.814953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:58.944918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eea8d-0ca8-4d48-9110-e9cd401012e3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:58.952756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 82/166] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:58.955116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:58.962173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:58.993667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:58.995476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:58.995476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:58.995671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.007467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.013732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:09:59.027132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:09:59.028181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:09:59.029183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:09:59.031342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 85/167] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:09:59.032535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.092119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c74541-a401-4d61-96fb-e28d946a56f6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.152547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.153253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.153541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.153828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.154709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:59.155008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.156481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.167660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 83/168] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:58 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.169021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.195546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dec6-5f9d-4d06-9f05-90bdda94b79b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.274652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.275355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.275643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.275924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.276734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:59.277047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.278573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.294307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 86/169] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.295223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.340257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.368540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.370984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830d85-14e4-4268-a5a1-c2c224f4627b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.421395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8cb2-fda0-4144-997f-65436572b91d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.443743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.444999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.444999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.445284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.448759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.450339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.452249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 84/170] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.453190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.461779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.463008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.463516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.463997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.464960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:59.465519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.467391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.477243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 87/171] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.478604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.591343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4516-99b9-4311-a0f7-797033aabe9d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.615739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646b89-9861-426f-9bd9-5a7a698f49a3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.617247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.630663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.631689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.632180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.632659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.633732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=4e3cc86167294f7c9616a6b3d1573df4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:09:59.634277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.635953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.643230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 88/172] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/role_assignments?user.id=4e3cc86167294f7c9616a6b3d1573df4&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.647308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.684193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.685112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.685403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.685684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.691164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.692680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.694489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 85/173] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.699952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.760967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.763672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4edc-7c01-44ce-baec-1d30d33e556c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.803949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.805264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.805759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.806272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] PATH_INFO: `/v3/users/e0e490f204044da49e3dfa0e62de8224` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.808709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e490f204044da49e3dfa0e62de8224)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:09:59.810570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:09:59.812607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 89/174] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/users/e0e490f204044da49e3dfa0e62de8224 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:09:59.819282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:09:59.858099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4706b-bebb-419c-a049-e0b71ab3c932 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:09:59.861110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:59.922936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:09:59.923616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:09:59.923905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:09:59.924189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:09:59.971136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9fbd6-6c17-40bc-b236-0b9f4a52e727 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:00.023974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:00.024804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:00.025196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:00.025583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:00.029310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.030831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.089693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:00.131904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.133604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.178558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:00.195402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 86/175] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:00.201308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:00.284675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 90/176] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:00.289450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:00.309589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bc79-8fd7-4108-a44a-5ed0a9363d6e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:00.346762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:00.347642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:00.347928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:00.348208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:00.355231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.356769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.358753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 87/177] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:00 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:00.373584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:00.378397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:00.476499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36795c-78b4-4a9f-803f-492d76b390ac None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:00.544465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63cdb-29dc-4bcb-a61c-55762412a444 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:00.545103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:00.590660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:00.591350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:00.591638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:00.591915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:00.592776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:00.593095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.594615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.596525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:00.597433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:00.597715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:00.597992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] PATH_INFO: `/v3/projects/840e3641fbfc4ff5b6af389b180e95e8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:00.599310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] RBAC: Authorizing `identity:get_project(project_id=840e3641fbfc4ff5b6af389b180e95e8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.600793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa41b4-e39d-4291-955c-e0d0fb97c14a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.601619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 88/178] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:00 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:00.602870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 91/179] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:00 2022] GET /identity/v3/projects/840e3641fbfc4ff5b6af389b180e95e8 => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:00.612523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:00.703413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:00.747295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e549-be7e-492d-997e-039dbc874eff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:00.784443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:00.785110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:00.785400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:00.785684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:00.786571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=840e3641fbfc4ff5b6af389b180e95e8, user.id=e0e490f204044da49e3dfa0e62de8224) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:00.786896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:00.788413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b075-0c7d-4b90-bfe6-9020d5bfb4b4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:00.796440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 89/180] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:00 2022] GET /identity/v3/role_assignments?user.id=e0e490f204044da49e3dfa0e62de8224&scope.project.id=840e3641fbfc4ff5b6af389b180e95e8&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:01.029719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c834-487b-433e-a6c5-c2f892592c54 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.030251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c834-487b-433e-a6c5-c2f892592c54 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.030985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c834-487b-433e-a6c5-c2f892592c54 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.032942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 92/181] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:01.038415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.038716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.039129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.063513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:01.064097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.148716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 90/182] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:01.175077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4c834-487b-433e-a6c5-c2f892592c54 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:01.306379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4c834-487b-433e-a6c5-c2f892592c54 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:01.349864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:01.351018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.351516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.351995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.365722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:01.373815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:01.374725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:01.375507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 93/183] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:01.380982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:01.457212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:01.496077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce732-6a2d-4903-b238-540f603230ed None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:01.532269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:01.532957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.533257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.533540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.534319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:01.534634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:01.536034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:01.545150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 91/184] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:01.550281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:01.609237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:01.665848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0797a17-df91-483c-9b1a-1fd0e51476c0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:01.701968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:01.702952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.703237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.703514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] PATH_INFO: `/v3/users/ce700726e09c400a86df26df099e8325` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.704728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] RBAC: Authorizing `identity:get_user(user_id=ce700726e09c400a86df26df099e8325)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:01.706215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c5ed8-a21a-4ddf-9e8e-a667a25a2686 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:01.708141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 94/185] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:01 2022] GET /identity/v3/users/ce700726e09c400a86df26df099e8325 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:01.713605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:01.788845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2a10-5579-43b9-ac87-0a8e3f70dfda None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.789474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2a10-5579-43b9-ac87-0a8e3f70dfda None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.789949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2a10-5579-43b9-ac87-0a8e3f70dfda None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.791863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 95/186] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:01.797702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9bd4-9b40-4333-8098-964e328e1c4d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.798007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9bd4-9b40-4333-8098-964e328e1c4d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.798319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9bd4-9b40-4333-8098-964e328e1c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.815600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-74fd9bd4-9b40-4333-8098-964e328e1c4d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:01.816788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-74fd9bd4-9b40-4333-8098-964e328e1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.826810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916f95-e2c6-45ec-b702-e920a4cec26f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:01.857583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:01.871031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:01.871031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.871031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.871031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.892525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 96/187] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:01.903622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fc52-f04b-47ed-ae19-42f70b812e48 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.903944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fc52-f04b-47ed-ae19-42f70b812e48 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.904425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fc52-f04b-47ed-ae19-42f70b812e48 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.905628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 97/188] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:01.910845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:01.911140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:01.911422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:01.927890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:01.929076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:01.951343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:01.953246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:01.981875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.007080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 98/189] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:02.010385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.067168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 92/190] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:02.067868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.092400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.112951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86713c0-be30-4365-b4d4-47eb648dc69a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.147958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.151160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.151463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.151746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.162325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:02.169670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f28a9a-7c5f-4766-9451-544a43a761a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9f319500-d591-4ef4-820f-688ef9dcddd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:02.170649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:02.171563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:02.172595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 99/191] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:02.173512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dcb30-22ac-49d4-a257-7a80360d0d81 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.173512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dcb30-22ac-49d4-a257-7a80360d0d81 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.173662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dcb30-22ac-49d4-a257-7a80360d0d81 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.178228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 100/192] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:02.178228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dcb30-22ac-49d4-a257-7a80360d0d81 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.211646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.212445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.212728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.213006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.214182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.215762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.217403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 93/193] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:02.219046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.222388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.282805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dcb30-22ac-49d4-a257-7a80360d0d81 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.312488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.317580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.318476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.318762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.319038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.320227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.321964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28bca4-6a70-4f12-b685-0ef2a93c87fb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.322087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e02c3-f2d5-42d7-9f8c-edf8586401b8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.323469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 101/194] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:02.324667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.324950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.325230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.341195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:02.342404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:02.354703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.355379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.356174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.356458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.357211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:02.357556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.358934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.366977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 94/195] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:02.367776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.410726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 102/196] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:02.411499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.451397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.473885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a34e7-768a-4fc3-bfda-e1af64ffeed9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.508325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.509055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.509282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.509560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.510302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.510938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cdf4a-be33-4dc7-8748-93fcd29b4fa7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.511757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.546318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.546975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.547260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.547536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.548368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943, user.id=ce700726e09c400a86df26df099e8325) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:02.548683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.550241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.555927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 103/197] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/role_assignments?user.id=ce700726e09c400a86df26df099e8325&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:02.556788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.597162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 95/198] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:02 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:02.598003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.614672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.691903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5844-3c6c-4067-8794-0131efe3850a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.694466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.725414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56de88-d03c-4860-8f95-705a058cfee9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.735673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.740184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.740184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.740184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.759813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.761730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.763988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 104/199] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:02.769420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.773136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.773638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.773934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.774252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.792694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:02.801903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:02.804050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:02.805067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 96/200] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:02.809385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:02.891530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.899788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e430f-c974-412d-b640-d8cded0cc3a4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.933517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613262-ef45-4a98-b669-1a3835a37cd4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:02.944405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.945925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.945925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.946111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.978182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:02.978900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:02.979191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:02.979474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:02.980272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:02.980631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:02.980759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:02.985123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:02.992990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 97/201] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:02.999017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.039728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.041274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.135111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a06d-4589-44bb-b4e5-b29daa34e233 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.170156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:03.175943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.176892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.177185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.177464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.178847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.180416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.188003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 98/202] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:03.188137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 105/203] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:03.189749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.189866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.266661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:03.308543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121830e9-1bc0-4e3f-b15e-05d357f65252 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.334544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5a54-c147-4e4e-8029-0a4f2f3187eb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.356223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.357421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.357848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.358288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.359642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.361254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.363168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 106/204] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:03 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:03.368893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.383001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.384063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.384549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.385152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.459008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:03.462661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.464529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.475629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4728a-be12-4a6c-924e-4329760fe41a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.504883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:03.513781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.514636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.514818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.515099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.515941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=15d0cd93bdd14dc092f4e6334a71d439) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:03.516260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.517740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.530240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 107/205] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:03 2022] GET /identity/v3/role_assignments?user.id=15d0cd93bdd14dc092f4e6334a71d439&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:03.590438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 99/206] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:03.599440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.710596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c093e-cef6-4148-a35a-cec0fd7b5a16 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.755796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.756588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.756875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.757157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.758382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.759972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19d61-7d23-438f-ade0-a045ebb5c929 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.761697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 108/207] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:03 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:03.767657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:03.874096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:03.877517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7275e3-8654-451b-bb54-a6cfef60f583 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:03.913428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:03.914113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:03.914429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:03.914708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:03.915564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=15d0cd93bdd14dc092f4e6334a71d439) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:03.915877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:03.917385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594898-bb71-4e52-a2a3-ec58d772a511 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:03.924849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 100/208] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:03 2022] GET /identity/v3/role_assignments?user.id=15d0cd93bdd14dc092f4e6334a71d439&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:04.855984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ac54-a484-4519-a120-f0a0be8aa394 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.856498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ac54-a484-4519-a120-f0a0be8aa394 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.856786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ac54-a484-4519-a120-f0a0be8aa394 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.858169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 109/209] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:04.863648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae1-ee2f-4dd7-a3a8-114c5abc9b8f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.864165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae1-ee2f-4dd7-a3a8-114c5abc9b8f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.864244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae1-ee2f-4dd7-a3a8-114c5abc9b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.882718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-85808ae1-ee2f-4dd7-a3a8-114c5abc9b8f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:04.883923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-85808ae1-ee2f-4dd7-a3a8-114c5abc9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:04.957130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 101/210] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:04.965060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0357e4-d419-463c-b5b0-ff517b247039 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.965353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0357e4-d419-463c-b5b0-ff517b247039 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.965636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0357e4-d419-463c-b5b0-ff517b247039 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.967319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 110/211] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:04.972723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:04.973027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:04.973314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:04.984038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0357e4-d419-463c-b5b0-ff517b247039 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:04.992608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:04.994332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:05.062587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.071465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 102/212] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:05.098048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.111690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0357e4-d419-463c-b5b0-ff517b247039 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.128114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.147364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.148437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.148437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.148729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.159709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:05.167700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:05.169142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:05.169963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 111/213] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:05.175134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.218825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b685aa1-6023-4b25-abd1-f1dc40b14508 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.259141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.260564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.260995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.261416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.262975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:05.264724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:05.266692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 103/214] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:05.272084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.278975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531b549-61ad-4b81-9aa0-ed5b4b90b5c8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.299675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.314353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.315036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.315328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.315613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.316372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:05.316685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:05.318091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:05.327271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 112/215] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:05.333788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.377393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.387254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1128-e9f1-437c-bd25-88bc53acb748 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.425473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.426463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.426912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.427334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.428296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:05.430111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b1a5-746e-48e5-b582-c876fee0d89f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:05.438574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2606-22b8-436a-b613-2c71f44c7f8d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.473894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.474807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.476087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.476087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] PATH_INFO: `/v3/users/1ce27d6d029147769de8d996502a15ad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.490811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] RBAC: Authorizing `identity:get_user(user_id=1ce27d6d029147769de8d996502a15ad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:05.492307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:05.494228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 113/216] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/users/1ce27d6d029147769de8d996502a15ad => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:05.500203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.541258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 104/217] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:05 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:05.553588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.621973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58e00b-4d1c-4fee-99af-881c23d9f614 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.661792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.662414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.662707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.662994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.676515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b62-9cf1-4fe1-85b6-1dd34b1b05e2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.676823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b62-9cf1-4fe1-85b6-1dd34b1b05e2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.677087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b62-9cf1-4fe1-85b6-1dd34b1b05e2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.678678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 105/218] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:05.684252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.684584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.684881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:05.703191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:05.704454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:05.740973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:05.742489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:05.784537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 106/219] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:05.792092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.812377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.861100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 114/220] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:05.866698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:05.916447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:05.950309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642cab-2e07-45b5-9767-0c16052cd559 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.995236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde39e1-a9b6-4a49-a9be-7e0e73600919 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:05.996132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:05.997715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:05.997995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:05.998314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.015746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:06.025790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:06.026825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:06.027674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:06.028276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 107/221] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:06.034136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.037139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.038371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.038888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.039358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.040636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.042121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b819761-8f0a-4a51-8347-b21cbed4dd53 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.044686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 115/222] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:05 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:06.045936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246c5a4-604d-4414-9096-b88d511162d5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.046300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246c5a4-604d-4414-9096-b88d511162d5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.046586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246c5a4-604d-4414-9096-b88d511162d5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.047958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 116/223] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:06.050714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246c5a4-604d-4414-9096-b88d511162d5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.066474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.169059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59095-f5ab-4969-8f31-5cb1f5cfd6a6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.195123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246c5a4-604d-4414-9096-b88d511162d5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.218292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.218981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.219270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.219556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.220898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:06.221213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.223200 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990493e-c55f-4387-bbf3-d309e07a0a68 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.235202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.239828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 108/224] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:06.240702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.241266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.241617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.241965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.242168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.242718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.243274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.244375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=1ce27d6d029147769de8d996502a15ad) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:06.250390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.250390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.255045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 117/225] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/role_assignments?user.id=1ce27d6d029147769de8d996502a15ad&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:06.256525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.262931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:06.265379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:06.358027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.365283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 109/226] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:06.388263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.395096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c67e-d4a7-4f2f-a26c-e29a39fd2d57 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.453648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.454957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.455447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.455945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.460903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.462783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.465393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 118/227] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:06.470989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.502673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d10bab-3e4e-4a73-93e6-23a7071d2fe0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.542598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.551346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.552279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.552566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.552912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.582976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:06.598594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:06.599550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:06.600351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 110/228] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:06.611248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.642703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75488f-1e96-418e-a328-723119e0a97f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.707513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.708438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.708726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.709005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.711131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.712619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.714594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 119/229] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:06.720384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.737309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.772718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a5de-3102-4436-91e8-daf7d6daa28a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.812909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.812909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.812909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.812909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.813320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:06.813609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.815975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:06.830377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 111/230] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:06.838316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:06.905629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f857-c825-4be7-868c-9d34c27f994d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:06.954567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:06.957407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:06.958810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:06.960485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:06.961766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/15d0cd93bdd14dc092f4e6334a71d439/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:06.965012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, user_id=15d0cd93bdd14dc092f4e6334a71d439, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:06.968746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:07.016492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20aee-4831-4aa2-8316-27f02d9de4de None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:07.048964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 120/231] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:06 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/15d0cd93bdd14dc092f4e6334a71d439/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:07.076538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:07.077449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:07.077741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:07.078026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:07.083126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:07.084632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:07.086742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 112/232] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:06 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:07.095046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:07.241002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:07.285667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91323bf-acca-466c-a1dc-bd8635c4fcf0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:07.331856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:07.332726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:07.333011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:07.333304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:07.334528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:07.335989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb54cd-dc74-463a-97b6-57e222db031d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:07.337863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 121/233] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:07 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:07.344018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:07.485896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f7c46-0c51-4975-85df-080af0ee277e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:07.507974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:07.522890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:07.524108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:07.524596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:07.525087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/15d0cd93bdd14dc092f4e6334a71d439/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:07.527750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, user_id=15d0cd93bdd14dc092f4e6334a71d439, role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:07.529511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41360b-a22e-47b9-bf1e-905f84a71822 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:07.602166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 113/234] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:07 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/15d0cd93bdd14dc092f4e6334a71d439/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:08.289189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07b0a-c234-40e5-ba58-fc454769a17a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.289189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07b0a-c234-40e5-ba58-fc454769a17a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.289189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07b0a-c234-40e5-ba58-fc454769a17a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.289189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 122/235] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:08.306766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.307386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.307386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.328918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:08.330119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:08.386718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c349-56b3-48e1-bc00-3de55a3d55e6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.387151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c349-56b3-48e1-bc00-3de55a3d55e6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.387541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c349-56b3-48e1-bc00-3de55a3d55e6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.389029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 123/236] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:08.394347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.394641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.394928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.414569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:08.416300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:08.440912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:08.500986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:08.533973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:08.565741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:08.694561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:08.698596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cecb2f-5d44-4ca9-bd55-382a36d502b4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:08.722517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:08.749857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:08.750695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.750980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.751309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.752463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:08.753944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:08.755921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 115/239] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:08.756291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbcda4-5c98-42eb-9e82-ebe93d4ff394 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:08.767147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:08.825788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:08.826903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.827273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.827619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.842558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d5ac667e-3638-4b9d-9bd0-5d31b3104210 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:08.851400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:08.852354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:08.853181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 125/240] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:08.853885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2ac0-a311-429e-ac3c-11bb3a01b7b5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.853957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2ac0-a311-429e-ac3c-11bb3a01b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.859510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2ac0-a311-429e-ac3c-11bb3a01b7b5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.860583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 126/241] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:08.861539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf2ac0-a311-429e-ac3c-11bb3a01b7b5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:08.896256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58139118-f6d9-49c8-90eb-ad732c2c76d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:08.936308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:08.937363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:08.938054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:08.938500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:08.939786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:08.941408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6277f-3a71-4865-bcd3-8b045fb4d5af None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:08.993981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf2ac0-a311-429e-ac3c-11bb3a01b7b5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.028256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.029003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 116/242] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:08 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:09.031058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.032159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.032697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.050050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.050864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.051150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.051480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.052240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:09.052551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:09.054691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:09.056267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:09.057993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:09.082360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 127/243] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:09.090258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.106077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.169348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 117/244] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:09.213178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.393113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228a8bb-b620-459c-a37a-64dd1f2c9016 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.436201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7429-84a0-4bc2-ada5-7415169e16c8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.462884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.464430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.465412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.466122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.495139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:09.501520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.502585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.502974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.503411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] PATH_INFO: `/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:09.520726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:09.521985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:09.523113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:09.523862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] RBAC: Authorizing `identity:get_user(user_id=7cbf83c0f7364f399bfa33d18dbca2a1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:09.525427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:09.527872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 128/245] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1 => generated 297 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:09.530383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 118/246] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:09.533182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.534008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.600087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.620338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:09.711642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e30d1-b67d-424e-a818-a3873d6118b2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.720889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea1ed-5b89-40c0-8791-bf4b43ddd1bc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:09.754180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.754899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.755189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.755472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.760460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:09.760787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:09.762795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab260-d704-4b10-a837-3397c85f5068 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:09.782238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 119/247] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:09.783460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1334-2353-482d-97e6-43bf71aeb792 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.783682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1334-2353-482d-97e6-43bf71aeb792 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.783963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1334-2353-482d-97e6-43bf71aeb792 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.790528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 120/248] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:09.795762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.796136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.796424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.797936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:09.798870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:09.799360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:09.799829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:09.822230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:09.822230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:09.898250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 121/249] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:09.899178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:09.919331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.003524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.005541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.010776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd786d-1167-4d45-b3df-768e778c9eb7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.050595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.051489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.051776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.052056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] PATH_INFO: `/v3/users/1ce27d6d029147769de8d996502a15ad` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.053448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] RBAC: Authorizing `identity:get_user(user_id=1ce27d6d029147769de8d996502a15ad)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.055370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.057383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 122/250] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/users/1ce27d6d029147769de8d996502a15ad => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:10.058132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.103346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.166583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.169278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 129/251] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:10.170340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.185111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211fbe-88b9-4b11-a800-ab9e755f8c7d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.229563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.231361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.231652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.231936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.245527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4f83fb15-5e5d-4450-9c4d-662f66468b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:10.256547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:10.257439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:10.258381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 123/252] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:10.264278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145b7-20df-479a-a2b9-a8b115972440 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.264577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145b7-20df-479a-a2b9-a8b115972440 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.264865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145b7-20df-479a-a2b9-a8b115972440 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.266743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 124/253] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:10.267332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8145b7-20df-479a-a2b9-a8b115972440 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.297333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13539d-8810-4d61-87bb-6f1b20eb4d22 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.338484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.340620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.341304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.341738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.343336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.345576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.348350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 130/254] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:10.349421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.372001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.399168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8145b7-20df-479a-a2b9-a8b115972440 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.437392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.438681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.439186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.439689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.441084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.442864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbb0af-d7c2-4342-93fd-9854b8c270d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.444917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 125/255] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:10.446486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8281a-211f-433d-b072-cf760343e734 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.446976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8281a-211f-433d-b072-cf760343e734 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.447463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8281a-211f-433d-b072-cf760343e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.471735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-35e8281a-211f-433d-b072-cf760343e734 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:10.473238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-35e8281a-211f-433d-b072-cf760343e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:10.481652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ddd3-c9f8-4598-877e-aacdac6b8881 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.482363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.520066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.521118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.521670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.522143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.523185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:10.523691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.525266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.534600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 131/256] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:10.535728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.570337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 126/257] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:10.571575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8281a-211f-433d-b072-cf760343e734 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.653636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.683136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7964-6cb1-4c63-977c-2a62ccdb6502 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.698400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8281a-211f-433d-b072-cf760343e734 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:10.740328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.741632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.742038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.742483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/1ce27d6d029147769de8d996502a15ad/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.744601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, user_id=1ce27d6d029147769de8d996502a15ad, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.747087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.747693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:10.748582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:10.749087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:10.749585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:10.750710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=7cbf83c0f7364f399bfa33d18dbca2a1) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:10.751267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:10.753021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:10.760070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 127/258] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/role_assignments?user.id=7cbf83c0f7364f399bfa33d18dbca2a1&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:10.763293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.773870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:10.842316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 132/259] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:10 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/1ce27d6d029147769de8d996502a15ad/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:10.847502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:10.944487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e2a2-bb7a-458c-a4fb-556f0ad9369a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.027706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.028530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.028819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.029100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.035205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:11.036699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:11.038936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 128/260] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:11.042038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b605b6-622c-463b-bedf-7d00a503e0f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.047508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.119370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.120622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.121107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.121805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.131419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:11.155232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:11.163916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:11.164774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:11.165554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:11.176028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 133/261] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:11.181696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.223415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:11.256644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207068af-f325-44e7-9cd8-719d514f3bdc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.295209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.295790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.296081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.296370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.356712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d575ea-f88e-4849-a554-961df1b85ca6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.369067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:11.370701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:11.418125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.419347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.419892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.420392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.421360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:11.421968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:11.423717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:11.440797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 134/262] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:11.446749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.459126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:11.507477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 129/263] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:11.516267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.562649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:11.642017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef485aa-fdec-4470-a781-4780f6f9be1f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.700671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.701573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.701859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.702141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] PATH_INFO: `/v3/users/15d0cd93bdd14dc092f4e6334a71d439` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.706981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] RBAC: Authorizing `identity:get_user(user_id=15d0cd93bdd14dc092f4e6334a71d439)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:11.708472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:11.710398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 135/264] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/users/15d0cd93bdd14dc092f4e6334a71d439 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:11.721639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.763775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a12a-2240-486a-9fec-ece0875172b7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.821323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.822099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.822412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.822684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:11.826981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:11.828453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:11.830318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 130/265] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:11.836041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:11.899386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:11.956312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cec2b-f523-4a9c-b539-7927c74bc052 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.961291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dfde-32c0-494e-b5cc-983f3a9758a2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:11.997433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:11.998367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:11.998790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:11.999231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.000271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=15d0cd93bdd14dc092f4e6334a71d439) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:12.000724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.002465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971e65-52f0-42b9-950b-b8f609766b81 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.009144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 131/266] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/role_assignments?user.id=15d0cd93bdd14dc092f4e6334a71d439&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:12.014573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.020272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.020962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.021256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.021542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.038590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8e4e-e285-42d4-b5e8-5acd8c66fff4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.038880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8e4e-e285-42d4-b5e8-5acd8c66fff4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.039164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8e4e-e285-42d4-b5e8-5acd8c66fff4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.040916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 132/267] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:12.047253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa182-9779-42dd-871d-80425f553c88 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.047542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa182-9779-42dd-871d-80425f553c88 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.047825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa182-9779-42dd-871d-80425f553c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.065720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-188aa182-9779-42dd-871d-80425f553c88 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:12.067186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-188aa182-9779-42dd-871d-80425f553c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:12.144257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.154234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.223611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 133/268] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:12.270110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 136/269] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:12.279438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa182-9779-42dd-871d-80425f553c88 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.287712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.342590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.365336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.451522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa182-9779-42dd-871d-80425f553c88 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.457172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f75621-918e-43c5-8587-0c806621cc65 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.498862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.499735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.500024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.500305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.501535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.502863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.503059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fc4e-23ec-4b9a-89ff-fc7008ed6b4b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.504052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.504535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.504747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 134/270] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:12.505273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.505938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583e7b-9d79-41a5-871e-d9da9758e03d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.506222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583e7b-9d79-41a5-871e-d9da9758e03d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.506528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583e7b-9d79-41a5-871e-d9da9758e03d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.507875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 135/271] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:12.515134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.515425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.515713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.522665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:12.530519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:12.531387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:12.532177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 137/272] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:12.532814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.539204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:12.540426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:12.642169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 136/273] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:12.642870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.675484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.680501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.700661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bffb-4f21-4195-92d9-9424dfa6223a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.745437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.747225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.747514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.747793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.748808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=15d0cd93bdd14dc092f4e6334a71d439) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:12.749453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.751304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.758415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebfcb-9f14-4b15-a600-95099b3116c0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.761737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 138/274] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/role_assignments?user.id=15d0cd93bdd14dc092f4e6334a71d439&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:12.762646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.811696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:12.812381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:12.812669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:12.813359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:12.814401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:12.814729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:12.816437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:12.833676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 137/275] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:12.841160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:12.932445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b2f6-9755-40df-be89-39bcd9f37f6b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:12.976945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:12.985015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e49c3-9fb6-4fea-b607-cdf33060f862 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.028334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.029158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.029448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.029831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] PATH_INFO: `/v3/users/1316de3ce4454f72967e3fc2dbfc45ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.031190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.032219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.032587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.033005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.034304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:13.035878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:13.037976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 139/276] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:13.044695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.045570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] RBAC: Authorizing `identity:get_user(user_id=1316de3ce4454f72967e3fc2dbfc45ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:13.047537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:13.051890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 138/277] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:12 2022] GET /identity/v3/users/1316de3ce4454f72967e3fc2dbfc45ed => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:13.058753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.067388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:13.168640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d1df4-bd9c-4b9b-b898-bd0a24895d31 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.196750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08f12b-8fc2-446a-a5f5-bbcf7d474998 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.213838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.215082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.215369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.215649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.216373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:13.217834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:13.242737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, user.id=1316de3ce4454f72967e3fc2dbfc45ed, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:13.250184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc95d9-6b3a-4ce4-ac38-c3f0d726ff36 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:13.254905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 139/278] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/role_assignments?user.id=1316de3ce4454f72967e3fc2dbfc45ed&scope.system=all&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:13.284554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810930-067a-4c80-9c03-32a6496b70b9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.284751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810930-067a-4c80-9c03-32a6496b70b9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.285035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810930-067a-4c80-9c03-32a6496b70b9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.286609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 140/279] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:13.293207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.293814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.294317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.313188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:13.314930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:13.326422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 140/280] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:13 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:10:13.334521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:13.405760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 141/281] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:13.429698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.518175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:13.545152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3a30d-085f-4b7a-8d35-c073f0ea612d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.584088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.584912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.585205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.585487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.598810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7bf9f183-7ae7-48a4-b9cb-986a05bd98cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:13.606853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:13.607777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:13.608561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 141/282] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:13.614154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.675814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd78c-1283-4a81-b885-1962a107c48a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.676780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd78c-1283-4a81-b885-1962a107c48a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.677267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd78c-1283-4a81-b885-1962a107c48a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.678896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 142/283] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:13.685022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.685340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.685595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.707634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:13.709214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:13.743321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b330-7d3f-4400-bc97-38f8ba97f1f5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.781737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.782437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.782720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.782999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.783754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:13.784061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:13.785467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:13.786227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 143/284] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:13.801954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 142/285] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:13.807163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.813069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:13.828161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:13.925345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375b291-84a7-4b7d-9dfd-d340d6686f50 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:13.962945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:13.964346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:13.964897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:13.965367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:13.976798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:13.985557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:13.986504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:13.987293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:13.994400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 143/286] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:13.996894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.018849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:14.104600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80204e3d-c1be-42bc-98bf-f015ca2c2632 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.113324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:14.148902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50fa1f-be96-4cb1-83f3-84619331b66e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.169592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.170501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.170784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.171061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] PATH_INFO: `/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.172999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] RBAC: Authorizing `identity:get_user(user_id=7cbf83c0f7364f399bfa33d18dbca2a1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.174516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.176458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 144/287] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1 => generated 297 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:14.181510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.262912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.263608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.263899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.264184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.264952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:14.265268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.266695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.288570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 144/288] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:14.294811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.296641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8469e-0de5-49e6-b762-765032b94d18 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.331813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:14.337575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.338492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.338778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.339052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.341054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.342543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.344634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 145/289] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:14 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:14.355952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.435973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0885a-fe9a-4683-a62c-0fa9a70b6ac0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.466619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:14.478868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.479769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.480646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.480927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] PATH_INFO: `/v3/users/1ce27d6d029147769de8d996502a15ad` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.482169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] RBAC: Authorizing `identity:get_user(user_id=1ce27d6d029147769de8d996502a15ad)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.483629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.485646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 145/290] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:14 2022] GET /identity/v3/users/1ce27d6d029147769de8d996502a15ad => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:14.490832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.552375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932bcf-0fee-49c9-9bcb-56779a11dcbe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.635902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.636791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.637080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.637358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/7cbf83c0f7364f399bfa33d18dbca2a1/roles/2e82e576bfa04b87b8dabf163ab916c0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.640700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a21b-e0a9-4def-9f05-3744a48f917c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:14.645438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, user_id=7cbf83c0f7364f399bfa33d18dbca2a1, role_id=2e82e576bfa04b87b8dabf163ab916c0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.646966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.689461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:14.690168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:14.690495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:14.690775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:14.722587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 146/291] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:14 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/users/7cbf83c0f7364f399bfa33d18dbca2a1/roles/2e82e576bfa04b87b8dabf163ab916c0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:14.774677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:14.782647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:14.784469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:14.915794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 146/292] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:14.921662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:14.988871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:15.032016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301534e5-8bb8-4e30-b60c-0ff9496676d7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:15.068064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:15.068966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:15.069369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:15.069875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:15.071729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:15.073194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc115ad-20ca-4f1a-92c0-e36b784df7d4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:15.075876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 147/293] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:14 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:15.083491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:15.212655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:15.220517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8756-590b-439c-ada3-8ea6e57e5b75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:15.280643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:15.281314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:15.281606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:15.281891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:15.282764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=1ce27d6d029147769de8d996502a15ad) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:15.283083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:15.284534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b7d6-5020-4eb4-90cc-687e96e5c01d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:15.295541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 147/294] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:15 2022] GET /identity/v3/role_assignments?user.id=1ce27d6d029147769de8d996502a15ad&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:15.765694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3560-600e-4f6d-9ea5-d2ab959ea823 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:15.766242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3560-600e-4f6d-9ea5-d2ab959ea823 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:15.766321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3560-600e-4f6d-9ea5-d2ab959ea823 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:15.767821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 148/295] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:15.773448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c26c2-6c68-49ac-a637-21a85defbae0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:15.773906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c26c2-6c68-49ac-a637-21a85defbae0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:15.774082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c26c2-6c68-49ac-a637-21a85defbae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:15.793723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c0c26c2-6c68-49ac-a637-21a85defbae0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:15.794944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c0c26c2-6c68-49ac-a637-21a85defbae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:15.871957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 148/296] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:15.896888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3560-600e-4f6d-9ea5-d2ab959ea823 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.010053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3560-600e-4f6d-9ea5-d2ab959ea823 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.025027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9222-3ec6-48d7-a747-06ce503833f5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.025260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9222-3ec6-48d7-a747-06ce503833f5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.025519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9222-3ec6-48d7-a747-06ce503833f5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.027617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 149/297] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:16.033140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6f30-80fa-4d0a-94e6-03c7b06a8ee4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.033438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6f30-80fa-4d0a-94e6-03c7b06a8ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.033720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6f30-80fa-4d0a-94e6-03c7b06a8ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.045731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.051928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99bf6f30-80fa-4d0a-94e6-03c7b06a8ee4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:16.053246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99bf6f30-80fa-4d0a-94e6-03c7b06a8ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:16.054890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.055725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.065629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.065629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.067902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:16.076038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:16.078116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:16.080153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 149/298] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:16.088394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.134037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 150/299] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:16.139623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcf74-aa47-4336-8237-f8f89289c2eb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.139913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcf74-aa47-4336-8237-f8f89289c2eb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.140192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcf74-aa47-4336-8237-f8f89289c2eb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.145912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 151/300] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:16.147196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.147484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.147763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.172079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:16.173261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:16.192048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.216327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb38ec-556f-4091-b080-1f918f4e6dc8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.258222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 152/301] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:16.258222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.267293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.269234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.269528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.269811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.270653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:16.270969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.272437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.282665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 150/302] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:16.283508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.335948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.361391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17afa90-4d8f-4759-8aa5-5268676fac83 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.389597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f578-373b-4134-ba38-d6d73795c6e3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.398368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.399176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.399463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.399749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.400924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.402480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.404332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 153/303] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:16.404919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.432655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.433592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.434588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.435043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.435475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.446732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:16.454768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:16.455901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:16.456908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:16.460751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 151/304] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:16.461639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.526942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194435a7-c30a-437f-8d90-84a41cf1db63 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.564903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.565695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.565984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.566288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] PATH_INFO: `/v3/users/1316de3ce4454f72967e3fc2dbfc45ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.567641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] RBAC: Authorizing `identity:get_user(user_id=1316de3ce4454f72967e3fc2dbfc45ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.568975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.575517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 154/305] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/users/1316de3ce4454f72967e3fc2dbfc45ed => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:16.575655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d8676-7437-448a-b72b-834661f0fb01 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.575736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.586007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.610871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.611654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.611948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.612242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] PATH_INFO: `/v3/groups` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.613221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.615146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.673281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:16.681703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 152/306] 10.222.0.61 () {60 vars in 1134 bytes} [Mon Jul 4 09:10:16 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:16.682744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.684328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712d577-7fd4-4ee4-9632-91a00cf0f314 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.737100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.738272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.738853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.739284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.740275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:16.740789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.742752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.755128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 155/307] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:16.761136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:16.812419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3063-1a65-450b-a38f-4a124966315d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.862860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.863842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.864167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.864482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] PATH_INFO: `/v3/system/users/1316de3ce4454f72967e3fc2dbfc45ed/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.868038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1316de3ce4454f72967e3fc2dbfc45ed, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.869257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.917771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb0c4-733e-4bad-9ea0-398c7a6b456c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:16.940488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 153/308] 10.222.0.61 () {58 vars in 1334 bytes} [Mon Jul 4 09:10:16 2022] PUT /identity/v3/system/users/1316de3ce4454f72967e3fc2dbfc45ed/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:16.969155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:16.970231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:16.970573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:16.970946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] PATH_INFO: `/v3/users/c0ddce9e74f54d84a08fbe346b80358d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:16.987560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] RBAC: Authorizing `identity:get_user(user_id=c0ddce9e74f54d84a08fbe346b80358d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:16.989125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff1e9f-308b-4bec-b6bc-a5eb1065a66a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:16.991368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 156/309] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/users/c0ddce9e74f54d84a08fbe346b80358d => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:16.997754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:17.038104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:17.058629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b275c-a9e4-4a54-8eed-a899c955bfb3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.058960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b275c-a9e4-4a54-8eed-a899c955bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.059197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b275c-a9e4-4a54-8eed-a899c955bfb3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.060940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 157/310] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:17.066496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.066786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.067065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.084506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:17.085696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:17.090466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:17.127926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636db1-731b-496d-9c6e-57cdb69c9aeb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:17.169733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:17.170459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.170813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.171026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.171896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, user.id=c0ddce9e74f54d84a08fbe346b80358d, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:17.172215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:17.173683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:17.178339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 158/311] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:17.186317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 154/312] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Jul 4 09:10:16 2022] GET /identity/v3/role_assignments?user.id=c0ddce9e74f54d84a08fbe346b80358d&scope.system=all&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:17.197817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:17.327964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6870bb-f4d7-4b16-9b82-de80ac0b64ac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:17.368631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:17.369797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.370364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.370837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.382527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:17.385720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:17.394460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:17.395352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:17.396227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 159/313] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:17.403046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:17.510788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:17.514354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066bcd1-c4bf-4b47-8516-35a7826a2693 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:17.550327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:17.551359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.551840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.552330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.553299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:17.553812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:17.555423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:17.570298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 155/314] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:17.572487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:17.681552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cf65-d183-4c4c-a720-75d574f7d853 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:17.717235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:17.718491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.718991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.719461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] PATH_INFO: `/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.720905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] RBAC: Authorizing `identity:get_user(user_id=7cbf83c0f7364f399bfa33d18dbca2a1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:17.722562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:17.724402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 160/315] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:17 2022] GET /identity/v3/users/7cbf83c0f7364f399bfa33d18dbca2a1 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:17.730233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:17.833095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9dbc-dbe5-4626-9b1e-d47a18386dd3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:17.868090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:17.868976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:17.869402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:17.869817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:17.899314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:17.945109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:17.946556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:18.055981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 156/316] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:18.061781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:18.136510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:18.173345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5bd7-a4ad-474a-9b6e-8ab9e0069967 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:18.209307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:18.210266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:18.210554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:18.210833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:18.212086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:18.213575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954ab04-d0b8-4c99-bdf7-5cd0b05d4dc0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:18.216189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 161/317] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:18 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:18.221676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:18.283456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:18.327741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f88b31-74f5-4d8b-88b3-ee23dabe7acf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:18.366559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:18.367225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:18.367510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:18.367785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:18.368624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0, user.id=7cbf83c0f7364f399bfa33d18dbca2a1) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:18.368937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:18.370426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c7d27-97c3-4704-98d8-24d813c14204 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:18.377473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 157/318] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:18 2022] GET /identity/v3/role_assignments?user.id=7cbf83c0f7364f399bfa33d18dbca2a1&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:18.926997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6df8-99ab-4d94-8f7a-e8573a416d70 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:18.927421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6df8-99ab-4d94-8f7a-e8573a416d70 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:18.927610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6df8-99ab-4d94-8f7a-e8573a416d70 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:18.929085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 162/319] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:18.934656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fab1-071f-481f-8919-7eda559053ef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:18.935095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fab1-071f-481f-8919-7eda559053ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:18.935312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fab1-071f-481f-8919-7eda559053ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:18.952379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d5b7fab1-071f-481f-8919-7eda559053ef None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:18.953577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d5b7fab1-071f-481f-8919-7eda559053ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:19.023955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 158/320] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:19.047146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a6df8-99ab-4d94-8f7a-e8573a416d70 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.060605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dda23-c610-49a7-bf9d-33fec42b14ec None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.060893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dda23-c610-49a7-bf9d-33fec42b14ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.061173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dda23-c610-49a7-bf9d-33fec42b14ec None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.062749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 159/321] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:19.067797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.068088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.068373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.085845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:19.086859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:19.144879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.159377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a6df8-99ab-4d94-8f7a-e8573a416d70 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.163951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 160/322] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:19.188724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.195269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.196077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.196364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.196647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.197836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:19.199372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:19.201236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 163/323] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:19.206568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.213053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.304626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49a9c-02b9-4e1e-8c60-2c4a386d48f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.320573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b392-e5e9-4a70-acfe-a92d3a3569a4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.339376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.340185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.340467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.340743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.351149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:19.353373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.354041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.354363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.355198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] PATH_INFO: `/v3/groups` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.355882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:19.357333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd628e-e0d1-4ec8-b8fa-c2d272c3a83d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0c096497-fad8-4930-9b41-850328eceeaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:19.359558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:19.360486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:19.361277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 161/324] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:19.362492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a2ba-c245-4995-a4ad-9cd247b822ed None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.362783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a2ba-c245-4995-a4ad-9cd247b822ed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.363067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a2ba-c245-4995-a4ad-9cd247b822ed None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.366450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 162/325] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:19.367538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a2ba-c245-4995-a4ad-9cd247b822ed None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.416468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.462240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 164/326] 10.222.0.61 () {60 vars in 1134 bytes} [Mon Jul 4 09:10:19 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:10:19.464731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.464731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.464970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.476444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a2ba-c245-4995-a4ad-9cd247b822ed None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.490123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:19.492048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:19.519439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.520194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.520474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.520756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.522033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:19.522383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:19.524085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:19.538851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 163/327] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:19.540376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.571388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.580194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 165/328] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:19.604060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.665412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1acd3-e1b4-4d0c-9d3f-00201472b511 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.673276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.705462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.706419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.706708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.706979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] PATH_INFO: `/v3/users/1316de3ce4454f72967e3fc2dbfc45ed` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.708264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] RBAC: Authorizing `identity:get_user(user_id=1316de3ce4454f72967e3fc2dbfc45ed)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:19.709905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:19.711639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 164/329] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/users/1316de3ce4454f72967e3fc2dbfc45ed => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:19.718586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.726967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75f52-d5af-451a-9634-a8c6a013b6f8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.770379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.771603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.772067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.772602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.788494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:19.797283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:19.798268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:19.799385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 166/330] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:19.805125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:19.859125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f3e-d89b-43c4-9496-cc9a53538e87 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.890245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:19.906445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.908176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.908176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.908176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.909343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] RBAC: Adding query filter params (role.id=6c20fa00522f4c2ebc9271f5a702779e, user.id=1316de3ce4454f72967e3fc2dbfc45ed, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:19.909343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:19.910428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:19.924203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 165/331] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/role_assignments?user.id=1316de3ce4454f72967e3fc2dbfc45ed&scope.system=all&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:19.954414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7075a-3a21-490d-bc4b-27e36d5ca0fc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:19.996797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:19.997455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:19.997746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:19.998031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:19.998886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:19.999237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:20.000758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:20.011791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 167/332] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:20.017134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:20.056369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:20.149481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c9ef-4589-4e7e-9a17-323ad8225ff4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:20.187272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbb539-173a-45da-89db-7160227e472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:20.188508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb539-173a-45da-89db-7160227e472d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:20.189000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb539-173a-45da-89db-7160227e472d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:20.189508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb539-173a-45da-89db-7160227e472d None admin] PATH_INFO: `/v3/users/c0ddce9e74f54d84a08fbe346b80358d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:20.191820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbb539-173a-45da-89db-7160227e472d None admin] RBAC: Authorizing `identity:get_user(user_id=c0ddce9e74f54d84a08fbe346b80358d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:20.193521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbb539-173a-45da-89db-7160227e472d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:20.195828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 166/333] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:20 2022] GET /identity/v3/users/c0ddce9e74f54d84a08fbe346b80358d => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:20.201775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:20.322317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf671-0f32-4b54-8c0c-0462fb6b54bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:20.343998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:20.365506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:20.366833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:20.367326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:20.367844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] PATH_INFO: `/v3/system/users/c0ddce9e74f54d84a08fbe346b80358d/roles/2e82e576bfa04b87b8dabf163ab916c0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:20.369705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0ddce9e74f54d84a08fbe346b80358d, role_id=2e82e576bfa04b87b8dabf163ab916c0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:20.371781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd894-95e2-45fe-abb6-cea4a853a9a4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:20.436821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 168/334] 10.222.0.61 () {58 vars in 1334 bytes} [Mon Jul 4 09:10:20 2022] PUT /identity/v3/system/users/c0ddce9e74f54d84a08fbe346b80358d/roles/2e82e576bfa04b87b8dabf163ab916c0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:21.867913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62d4f-bf25-44de-8793-dc4dc8fa0233 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:21.868451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62d4f-bf25-44de-8793-dc4dc8fa0233 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:21.868714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62d4f-bf25-44de-8793-dc4dc8fa0233 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:21.870705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 167/335] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:21.876633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591843f-4ae8-44e6-b753-406855619baa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:21.877078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591843f-4ae8-44e6-b753-406855619baa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:21.877270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591843f-4ae8-44e6-b753-406855619baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:21.899201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a591843f-4ae8-44e6-b753-406855619baa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:21.900412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a591843f-4ae8-44e6-b753-406855619baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:22.004214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 169/336] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:22.053426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62d4f-bf25-44de-8793-dc4dc8fa0233 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:22.163302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5fd3-c233-4ddd-91d2-63584bf0281d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.163302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5fd3-c233-4ddd-91d2-63584bf0281d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.163302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5fd3-c233-4ddd-91d2-63584bf0281d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:22.163997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 170/337] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:22.170321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.170931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.171410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:22.193704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:22.196028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:22.223508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:22.226603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62d4f-bf25-44de-8793-dc4dc8fa0233 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:22.267255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:22.268098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.268385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.268710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:22.283340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:22.291745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:22.293324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:22.294096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 168/338] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:22.304052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:22.366718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 171/339] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:22.417282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:22.498572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4ad6-7d7b-4d80-aa26-68e27418bb1e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:22.513332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:22.576647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573726-92da-4312-b221-60c646026503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:22.577499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573726-92da-4312-b221-60c646026503 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.577768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573726-92da-4312-b221-60c646026503 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.578044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573726-92da-4312-b221-60c646026503 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:22.578833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573726-92da-4312-b221-60c646026503 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:22.579141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573726-92da-4312-b221-60c646026503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:22.580548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573726-92da-4312-b221-60c646026503 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:22.593883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 169/340] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:22.602460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573726-92da-4312-b221-60c646026503 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:22.643552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185dd5-6769-462b-b637-ac89cb687e29 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:22.654843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:22.730955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:22.731798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.732134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.732419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:22.763162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:22.771473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:22.772372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:22.773179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 172/341] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:22.780970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:22.830001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573726-92da-4312-b221-60c646026503 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:22.911538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:22.912287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:22.912551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:22.912831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.022307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.029599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28424c7-31ca-4a20-b657-4d0c3181dfd6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:23.058797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:23.063247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:23.106224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:23.106926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.107220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.107506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.108267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:23.108582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:23.109974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa9bf7-04fd-4186-b227-b865b133b8d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:23.114891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.125687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 173/342] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:23.127387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014ea-6d85-40b7-b5c5-6a6f3a47e702 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.127858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014ea-6d85-40b7-b5c5-6a6f3a47e702 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.128312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014ea-6d85-40b7-b5c5-6a6f3a47e702 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.134330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 174/343] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:23.140712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.141240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.141698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.172678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:23.174181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:23.211721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 170/344] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:23.212838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:23.328134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 175/345] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:23.329344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:23.334229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb946-197e-43bd-937f-bd50e6a13350 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:23.361694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.384554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:23.385235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.386047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.387425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.511208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.519506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:23.522233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267ea2-f30a-42fe-bc19-32d2c9e6d3c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:23.528868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7935-e05e-4514-90e7-2c9b32217713 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:23.597814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:23.598698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.598988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.599287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.600745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:23.602242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:23.604470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 176/346] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:23 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:23.608091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:23.690658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 171/347] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:23.695591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389079f-4c3e-44a3-8995-92b60fc2dce1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.695881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389079f-4c3e-44a3-8995-92b60fc2dce1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.696160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389079f-4c3e-44a3-8995-92b60fc2dce1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.697670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 172/348] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:23.698377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389079f-4c3e-44a3-8995-92b60fc2dce1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:23.732700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.758700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdfe39-b22e-4a3b-8a90-af0b8123ee68 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:23.811148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:23.812111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.812501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.812787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.825305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:23.832122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389079f-4c3e-44a3-8995-92b60fc2dce1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:23.834779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:23.835719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:23.836577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 177/349] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:23.837280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:23.868939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:23.893847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:23.894914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.895304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.895686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.902507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:23.904139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40dda1-f2ba-46a7-b820-5035f50fdddc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:23.906302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 173/350] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:23 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:23.907638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:23.908050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:23.908436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:23.931754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:23.933694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:23.964104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91d3d-d743-4d2b-9c2a-543257f957a3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.003617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.004859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.005350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.005875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.007350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.009016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2e03-829c-4dc8-a55a-9b0ebad8dab8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.011453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 178/351] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:23 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:24.012917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59c40-6544-4817-aa34-bb3c7b3bef54 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.013202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59c40-6544-4817-aa34-bb3c7b3bef54 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.013478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59c40-6544-4817-aa34-bb3c7b3bef54 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.018985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 179/352] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:24.018985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59c40-6544-4817-aa34-bb3c7b3bef54 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.025857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 174/353] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:24.027087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.054549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.153546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.167224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624ca5-5fe0-43aa-b7e7-230e6386c04a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.174972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59c40-6544-4817-aa34-bb3c7b3bef54 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.213655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.215320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.215320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.215320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.215985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:24.216301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.218156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.223712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 175/354] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:24.224538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.227770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.230360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.231590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.232116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.233244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:24.233772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.235607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc143d-ebdb-4922-b218-bdfae627496f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.247025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 180/355] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:24.248803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.249310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.249820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.269413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:24.270935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:24.336188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.361054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 181/356] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:24.361839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.363561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12dde-a8cf-4ac5-a41d-9019d0d6a8f4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.413168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.414596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.415012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.415474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.417371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.420383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c973-1515-457e-a80c-5c5bc1d0619f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.422076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 176/357] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:24.423363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d499f-cd90-4058-977f-53f958c9db9c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.423685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d499f-cd90-4058-977f-53f958c9db9c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.423932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d499f-cd90-4058-977f-53f958c9db9c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.425160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 177/358] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:24.425852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d499f-cd90-4058-977f-53f958c9db9c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.485928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.507698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86244f1-4d80-4f99-bf7d-0d0197897838 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.552732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.553391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d499f-cd90-4058-977f-53f958c9db9c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.553537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.553827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.554099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.573369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:24.582238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:24.583176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:24.584037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:24.584653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 182/359] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:24.585364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.611566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.612291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.612581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.612864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.635326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.704443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.706421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3083040-a01a-4285-a226-8674269a7c16 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.728576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56bdb5-da8b-4ae2-9e50-bad5678aa431 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.774419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.775591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.776705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.777209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.789393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.793500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:24.801451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:24.802436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:24.803225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 183/360] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:24.803896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.850604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 178/361] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:24.852024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.852377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.852717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.875725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:24.966701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:24.966701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:24.967359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd9b9-b84d-4379-a485-5d28a735d7d9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:24.967447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 179/362] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:24.967447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:24.983278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:24.984069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:24.984478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:24.984764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:24.985646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:24.985964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:24.987493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:24.993970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 184/363] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:24.998304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.077826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.101507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55ccd-8785-4dcb-979d-f8cd4a8d7fb0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.130440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24073660-e833-4006-9d7d-462b06bfab49 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.156906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.157593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.157878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.158155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.158947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:25.159260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.160686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.179521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 180/364] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.180092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.195864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.196657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.196877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.197097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.197879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:25.198214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.199597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.215030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 185/365] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.215955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.234272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.304261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444aef-4b49-4f92-94e4-395432efde1e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.341772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.342690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.342978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.343256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.344508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.345958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.348278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 181/366] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.349058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.349765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95dc3-1af6-4e01-b023-331350a2f3b7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.396715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.397847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.398385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.399478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.400771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.415762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:25.427624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:25.428542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:25.429318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:25.432313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 186/367] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:25.433788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.484024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348fdc-b39a-4c7f-8a17-e52b867dde95 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.495723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.524415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.525320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.525788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.526272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.561259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8619-9e5f-445b-aee5-7ff5353e962b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.602223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.602948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.603235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.603518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] PATH_INFO: `/v3/users/c0ddce9e74f54d84a08fbe346b80358d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.605149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.605903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ddce9e74f54d84a08fbe346b80358d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.607114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.607468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.609573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 187/368] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/users/c0ddce9e74f54d84a08fbe346b80358d => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.610419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.674386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.721995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 182/369] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:25.723083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70bec5-43ac-4756-afda-1a87f22fb574 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.723236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.734871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.762140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.762404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.762696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.762976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.764250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.767106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.768997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 188/370] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.774623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.859578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa3b2-16a5-4f28-9c9e-193f46f3e0aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.914683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.914885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.915134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.915404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.916162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:25.916498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.917889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:25.929522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadef91d-0c48-4881-a293-a1946a0743e5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:25.935058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 183/371] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:25.935981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:25.959491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:25.978996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:25.979678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:25.979967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:25.980248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:25.983305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] RBAC: Adding query filter params (role.id=2e82e576bfa04b87b8dabf163ab916c0, user.id=c0ddce9e74f54d84a08fbe346b80358d, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:25.983976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:25.986032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.000452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 189/372] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/role_assignments?user.id=c0ddce9e74f54d84a08fbe346b80358d&scope.system=all&role.id=2e82e576bfa04b87b8dabf163ab916c0 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.001616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.029614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.065971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53601-77fa-4963-9c09-7981cc3b72c9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.106098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.107105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.107400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.107684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.108896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.110415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.112889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 184/373] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:25 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.113415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.128807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c506b-58d6-4096-bbef-3701d2006475 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.170004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.171166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.171679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.172167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.173227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:26.173845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.175669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.183576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 190/374] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.184887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.233547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120dc76-4203-40aa-bb67-d410a4e6c77d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.249933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.272857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.273558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.273894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.274129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.286772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.357320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.358864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.360230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39bf3b-e8a8-4f1b-ac4a-e1a812c0ff57 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.452013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.453274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.453777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.454300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.459096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.461700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.464447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 191/375] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.470838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.473938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 185/376] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:26.479798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.527007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.612094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786e0a-6e6c-4afe-b449-605da6e41d0c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.618445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedfe07-bd8a-4931-8eac-732deeb641a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.637872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.661683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.663470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.664097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.664586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] PATH_INFO: `/v3/projects/b76267d843014c29925a4e096c435d8d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.666215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] RBAC: Authorizing `identity:get_project(project_id=b76267d843014c29925a4e096c435d8d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.668761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.669427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.670207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.670586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.670939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.671615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 186/377] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/projects/b76267d843014c29925a4e096c435d8d => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.672228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:26.672609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.674139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.677040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.683197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 192/378] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:26.791469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac798a2-b57f-4909-b61a-3382231a701d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:26.800730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:26.830554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:26.831670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.832093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.832535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] PATH_INFO: `/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.838253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] RBAC: Authorizing `identity:get_group(group_id=3d7c915b0db5473a8a3f94eb2eefb46d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:26.840468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe8ee-c059-48a0-a615-9af84d7ef37c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:26.842891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 187/379] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:26.849039 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:26.895101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42413-d225-4e84-aadf-a092b05a5fe1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.895624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42413-d225-4e84-aadf-a092b05a5fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.896045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42413-d225-4e84-aadf-a092b05a5fe1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.898491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 188/380] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:26.911719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:26.912013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:26.912295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:26.951409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:26.952652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:27.016692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ffa7-a85a-472e-93ab-d6694f9c19e4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:27.092047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:27.092729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.093016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.093295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.094584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] RBAC: Adding query filter params (group.id=3d7c915b0db5473a8a3f94eb2eefb46d, role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=b76267d843014c29925a4e096c435d8d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:27.094877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:27.096348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:27.100586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 189/381] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:27.107917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 193/382] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:26 2022] GET /identity/v3/role_assignments?group.id=3d7c915b0db5473a8a3f94eb2eefb46d&scope.project.id=b76267d843014c29925a4e096c435d8d&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:27.152599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:27.295320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:27.298714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e26f-2fed-4b8a-8c40-d6dca355907d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:27.339653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:27.340475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.340758 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.341029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.363265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:27.371970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:27.372872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:27.373667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 190/383] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:27.379399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:27.455191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:27.539252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41655d53-308a-430f-ad18-f085021931d7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:27.584119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:27.584861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.585148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.585432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.586462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:27.586776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:27.588177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:27.602091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 194/384] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:27.608573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:27.751910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290072bb-a8f5-4be3-b769-767a9044a0a0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:27.799435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:27.800306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.800591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.800871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.802054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:27.803536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:27.805323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 191/385] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:27 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:27.811647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:27.924311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4391-46a6-4300-9396-7c9e480996d1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:27.927176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:27.969274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:27.970148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:27.970456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:27.970778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:27.971999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:27.973451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46e356-6a7c-4884-b093-bef1c1de70d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:27.975197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 195/386] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:27 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:27.982151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:28.014015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:28.040890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcaff9-4ecf-4d52-87f3-a56df88e193b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.041219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcaff9-4ecf-4d52-87f3-a56df88e193b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.042085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcaff9-4ecf-4d52-87f3-a56df88e193b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.043648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 196/387] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:28.050004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.050314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.050593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.076229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:28.077473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:28.173380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8406-9c23-4b95-a1e9-30d101db0503 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:28.225185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 197/388] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:28.239480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:28.240597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.241079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.241528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/groups/e17c807e3281454da273028ea31f1274/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.243810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, group_id=e17c807e3281454da273028ea31f1274, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:28.245473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:28.267844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:28.322327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 192/389] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Jul 4 09:10:27 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/groups/e17c807e3281454da273028ea31f1274/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:28.386621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:28.389690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b967e-d487-4841-8bf1-5741626b6669 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:28.428026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:28.428862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.429144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.429419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.441747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:28.450939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:28.451922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:28.452705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 198/390] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:28.459246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:28.586769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:28.598930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3182c-c7a2-4422-b2f5-4765700b48c5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:28.652558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:28.653254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.653598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.653881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.654725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:28.655039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:28.656472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dced84-e652-4c7a-878c-95c4cb4d48fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:28.665721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 193/391] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:28.671417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:28.783794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9dd4-197f-4aeb-bfdb-9d924f41eb28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:28.814000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ad52-a054-4ee6-bdd4-4c368ac279a6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.814377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ad52-a054-4ee6-bdd4-4c368ac279a6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.814585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ad52-a054-4ee6-bdd4-4c368ac279a6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.817190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 194/392] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:28.822079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.823340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.823676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:28.824041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.824558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:28.824851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:28.825131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:28.826904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:28.828381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:28.830248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 199/393] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:28 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:28.836675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:28.843954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:28.845447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:28.899623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:28.942316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 195/394] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:29.019280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a3b-58f0-459f-bb8e-31180c9cba25 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.023926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.093876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.094945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.095465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.096001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.097534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.099215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a15e8-a0d4-45fd-9a75-344611075f0b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.101471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 200/395] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:28 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:29.103001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783a81-6c1b-42e7-a402-24f0eabfcff2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.103495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783a81-6c1b-42e7-a402-24f0eabfcff2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.104477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783a81-6c1b-42e7-a402-24f0eabfcff2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.106254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 201/396] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:29.112684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.112969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.116727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.131925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:29.133561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:29.145901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.168315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173f8b7-15e9-4b8a-999c-55c4c08a2951 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.208258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.209071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.209360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.209641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.210321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 202/397] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:29.211527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.229979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:29.240988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:29.247484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:29.248452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:29.249381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:29.261187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 196/398] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:29.261187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.330826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae7e5-395a-474a-94a8-300daf772756 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.362343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54189dc-390a-4dcc-95e6-f58dff60ba1f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.368574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.370452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.371004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.371718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/groups/e17c807e3281454da273028ea31f1274/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.374415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] RBAC: Authorizing `identity:create_grant(project_id=261d20cc10a3466d9e68d7c6a2cfb943, group_id=e17c807e3281454da273028ea31f1274, role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.376181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.399393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.400204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.400493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.400805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.409209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.413093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:29.421853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:29.426991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 197/399] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:29.427815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.449318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 203/400] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Jul 4 09:10:29 2022] PUT /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943/groups/e17c807e3281454da273028ea31f1274/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:29.451504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.574646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04936d-cc0e-4b0b-8d9a-1bd968df91bf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.619631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892fdb-6902-4d4d-a3fa-a059cf71afc5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.656023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.656746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.657029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.657300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.658051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:29.658402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.659782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.666075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.667328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.667615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.668353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.669123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:29.669728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.671170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.671477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 204/401] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:29.676934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.681690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 198/402] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:29.687275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.781347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.822299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab825a-3048-4e5c-a953-c6c2b20151ea None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.870515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087f45d-f5c6-4796-8d10-029529debc39 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:29.903855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.905104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.905595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.907683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.910116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.911835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.917112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 205/403] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:29.922456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:29.945746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:29.949045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.949546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.950541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.954411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:29.956090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e0ef-757f-4ba3-870e-8e7998b3320b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:29.962109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 199/404] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:29.966875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:29.973070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9916-4fa6-42b1-96d6-5e29b85f3325 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:29.973441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9916-4fa6-42b1-96d6-5e29b85f3325 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:29.973620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9916-4fa6-42b1-96d6-5e29b85f3325 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:29.975262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 200/405] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:29.981178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9916-4fa6-42b1-96d6-5e29b85f3325 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.068446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55ee4-8f04-41d4-851f-1b5f2e92f1da None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.108202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.109362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.109653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.109980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.111353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:30.112818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022577e-e505-4511-8c2f-0d6fa76daa98 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:30.115332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 206/406] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:30.116681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.117041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.117594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.146302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:30.147744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:30.148964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9916-4fa6-42b1-96d6-5e29b85f3325 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.221094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:30.232300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.233920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.234336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.234762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.236611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:30.238111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:30.245575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 201/407] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:29 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:30.245575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.252836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 207/408] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:30.261298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.292287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:30.376312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5440d9-7e6b-4b2d-b9b8-b2ae21cf243e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.388316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584d8f-b92f-4e71-8bb8-b2f3fe15bba8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.425480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.426491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.426980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.427381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.427654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.427753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.427932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/groups/e17c807e3281454da273028ea31f1274/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.428412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/groups/e17c807e3281454da273028ea31f1274/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.429910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, group_id=e17c807e3281454da273028ea31f1274, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:30.431182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0efb0b6f2f5e4422976f010f8a7444b0, group_id=e17c807e3281454da273028ea31f1274, role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:30.431401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:30.433548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:30.532711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 208/409] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Jul 4 09:10:30 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/groups/e17c807e3281454da273028ea31f1274/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:30.534309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.562880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 202/410] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Jul 4 09:10:30 2022] PUT /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0/groups/e17c807e3281454da273028ea31f1274/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:30.661741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:30.696694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04541f3-7b97-4f71-8b49-f76033f00661 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.747372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.748204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.748543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.749258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.762794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-04b2ea98-4c93-4de8-af7a-39eff7e741aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:30.771111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:30.772073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:30.772892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 209/411] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:30.778812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.784596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec5b0-2a86-432c-aefd-16920413a0ee None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.784596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec5b0-2a86-432c-aefd-16920413a0ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.784596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec5b0-2a86-432c-aefd-16920413a0ee None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.785250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 210/412] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:30.790690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:30.791765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:30.792210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:30.818260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:30.818733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:30.904942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:30.914319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 211/413] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:30.941260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:30.956582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc358b-ecd0-4b2f-837f-2944855ca5d3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:30.998709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:30.999698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.000131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.000697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.001729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:31.002185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.003792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.014926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 203/414] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:31.023475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.025801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:31.065134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e242bb-22f6-430e-a235-d62f2140d687 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.103510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.104398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.104689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.104970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.129871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:31.141376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:31.145041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:31.145829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 212/415] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:31.152754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.260894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ccf6-6d03-43b6-9dc9-ddb4f6fe3312 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.275805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c2be-c3dd-4980-ae79-120b2c775e91 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.312584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:31.315292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:31.321288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.321966 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.322282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.323261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.324031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:31.327626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.327626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.335531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 213/416] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:31.341020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.344204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.345091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.345379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.345658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] PATH_INFO: `/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.346927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] RBAC: Authorizing `identity:get_group(group_id=3d7c915b0db5473a8a3f94eb2eefb46d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.348376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.350334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 204/417] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d => generated 229 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:31.356044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.464735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68298cb8-1094-42ef-a855-fdbf40e5703e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.534703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.535323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.535593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.535834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.581381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab89e3-492e-4744-9547-888372c00ab7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.648862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:31.657480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.658467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.658833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.659230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] PATH_INFO: `/v3/projects/b76267d843014c29925a4e096c435d8d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.662992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] RBAC: Authorizing `identity:get_project(project_id=b76267d843014c29925a4e096c435d8d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.664673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.671371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 205/418] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/projects/b76267d843014c29925a4e096c435d8d => generated 344 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:31.677780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.677926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:31.679099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.788774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:31.844747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 214/419] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:31.851375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:31.900805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaebdd-e2c4-45cb-b20a-77fb74bb4b58 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:31.985761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:31.986688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:31.986985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:31.987269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] PATH_INFO: `/v3/projects/b76267d843014c29925a4e096c435d8d/groups/3d7c915b0db5473a8a3f94eb2eefb46d/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:31.992471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76267d843014c29925a4e096c435d8d, group_id=3d7c915b0db5473a8a3f94eb2eefb46d, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:31.993961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a540c-a595-42c7-ac90-263eb23c3de8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:32.017398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:32.030172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a397-c9a0-41d4-8930-321719c33c70 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.065703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.066547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.066834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.067115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.068414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:32.069917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f057ff7-fac7-4d61-bb6b-1e28a2572d61 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:32.071911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 215/420] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:31 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:32.073841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e57e-51f3-4cce-81ca-64f6ac4c9a00 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.074159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e57e-51f3-4cce-81ca-64f6ac4c9a00 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.074475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e57e-51f3-4cce-81ca-64f6ac4c9a00 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.076207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 216/421] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:32.080573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5e57e-51f3-4cce-81ca-64f6ac4c9a00 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:32.092521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 206/422] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Jul 4 09:10:31 2022] PUT /identity/v3/projects/b76267d843014c29925a4e096c435d8d/groups/3d7c915b0db5473a8a3f94eb2eefb46d/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:32.093611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.093907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.094210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.120956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:32.122870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:32.213261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 207/423] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:32.255180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:32.322393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:32.332002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5e57e-51f3-4cce-81ca-64f6ac4c9a00 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.379316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.380349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.380742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.381128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.384884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:32.386516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:32.388350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 217/424] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:32 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:32.391591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b7f12-ba87-4364-8e6d-a9a86aa8d5e1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.398270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:32.436432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.437699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.439743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.440229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.454174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:32.465363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:32.479219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:32.480195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:32.480980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:32.485558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 208/425] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:32.491069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:32.550709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe9920-5cc2-4b7a-bc93-c0e232ac9f0e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.593899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.595356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.598421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.598746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.599721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:32.600043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:32.601518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:32.612348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 218/426] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:32 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:32.689171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb20e-1745-4eec-9cc0-96dac9db3f8b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.698068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:32.743087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.743828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.744119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.744928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:32.745755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:32.746383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:32.747861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240b4a6-2e7b-4af4-a80e-3e654693f0fb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:32.763151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 209/427] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:32.769026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:32.872701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:32.894876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89910e41-746e-4d46-be04-87a81fde77a4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:32.938101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:32.938817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:32.939102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:32.939387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.010569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c45e-5b12-4108-b732-262a7dd18deb None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.010898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c45e-5b12-4108-b732-262a7dd18deb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.011154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73c45e-5b12-4108-b732-262a7dd18deb None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.014702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 210/428] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:33.015313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.016801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.019091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.019386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.019671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.038970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:33.040187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:33.111622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.118318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 211/429] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:33.128648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 219/430] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:33.133991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.144365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.248830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.253020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdfa6b-488c-4bbf-9e43-6969cc3ccacf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.306068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.307106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.307397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.307677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] PATH_INFO: `/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.308924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] RBAC: Authorizing `identity:get_project(project_id=261d20cc10a3466d9e68d7c6a2cfb943)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.309587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078677-2ca9-4a26-b3c0-93de291565d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.310967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab3ab1-89eb-4611-a5d7-64dca53faf2f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.312379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 212/431] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/projects/261d20cc10a3466d9e68d7c6a2cfb943 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:33.313384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee4c9-b8e2-40fb-9280-a9797dec41c2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.313673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee4c9-b8e2-40fb-9280-a9797dec41c2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.313955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee4c9-b8e2-40fb-9280-a9797dec41c2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.315393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 213/432] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:33.319975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee4c9-b8e2-40fb-9280-a9797dec41c2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.361278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.362510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.363078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.363572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.380017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-da1e11d8-b96f-4a61-9b37-855941730772 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:33.388001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:33.388898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:33.389688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 220/433] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:33.391383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.391615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.392738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.411364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:33.412574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:33.451657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee4c9-b8e2-40fb-9280-a9797dec41c2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.457695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.494584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 221/434] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:33.495809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.501442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.502430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.502789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.503137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.504453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.506129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.508030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 214/435] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:33.513774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.550354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.609397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892efd5-027c-4599-bcd5-b10c2576c1d0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.625333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ea8ee-07be-4058-a92c-ca73f913448b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.649775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.650455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.650750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.651002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.651872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:33.652186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.653566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.664240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.664907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.665199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.665479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.666978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:33.667384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.668056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 222/436] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:33.668713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.668856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.676204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 215/437] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=261d20cc10a3466d9e68d7c6a2cfb943&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:33.679210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.713528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.784141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2732-5c49-4abb-95a2-6b66dac99090 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.825009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.825789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.826133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.826442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.827800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:33.833438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cd3a-efda-48b1-8d7a-7bc51f5311be None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:33.841580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:33.852793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:33.854372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:33.855191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:33.855789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 223/438] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:33.861725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:33.877075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:33.878424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:33.878726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:33.879016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:33.970649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:33.972476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:33.999511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.004412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db617a5-8037-4a69-99b8-e69a574b5f78 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.058060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.059423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.059718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.060080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.061017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:34.061334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.062767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.076734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 224/439] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:34.082528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.104233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.116430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 216/440] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:34.117422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.223014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44337-7906-49d7-9169-75250f530e10 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.230811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822103f-9990-4e94-8078-744b0cac31a5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.262178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.262954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.263242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.263521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.269079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.270166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.270649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.271104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.272506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.273963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.275947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 217/441] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:34.281220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.292394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.333689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.335178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef768b-f680-40ff-b09a-4dff4012bcf4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.352565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.390873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c685c2-1dc0-4d77-91e0-c63b15e08c76 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.425271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.426140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.426457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.426738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.427939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.429506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73e98e-3547-4721-aacd-c494c105d52d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.431196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 218/442] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:34.432928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d2541-5894-4138-9aa3-1c6ad79abb17 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.433234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d2541-5894-4138-9aa3-1c6ad79abb17 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.433502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d2541-5894-4138-9aa3-1c6ad79abb17 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.435041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 219/443] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:34.437685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d2541-5894-4138-9aa3-1c6ad79abb17 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.443322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 225/444] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:34.444592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.444883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.445160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.462371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:34.463593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:34.520954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.532082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 226/445] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:34.532925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.543664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d2541-5894-4138-9aa3-1c6ad79abb17 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.578761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.579430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.579711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.579996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.580825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=6c20fa00522f4c2ebc9271f5a702779e, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:34.581140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.582615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.584430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.588913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 220/446] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=6c20fa00522f4c2ebc9271f5a702779e => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:34.589701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.646803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfc2da-ec24-4ec0-a6a5-7dd37fcca3ff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.685049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.685931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.686450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.686736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] PATH_INFO: `/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.688028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] RBAC: Authorizing `identity:get_project(project_id=0efb0b6f2f5e4422976f010f8a7444b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.689515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.691642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 227/447] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/projects/0efb0b6f2f5e4422976f010f8a7444b0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:34.697049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.707598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec83c0-1274-474c-9850-8da14d57f17b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.746282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.747107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.748038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.748038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.759949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:34.764906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:34.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:34.768814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:34.769916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 221/448] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:34.787775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.817092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4366f-a062-4e32-bcb2-551d9a490a39 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.854746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:34.862782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.864680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.864921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.865236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] PATH_INFO: `/v3/groups/e17c807e3281454da273028ea31f1274` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.867059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] RBAC: Authorizing `identity:get_group(group_id=e17c807e3281454da273028ea31f1274)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.868651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.870481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 228/449] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/groups/e17c807e3281454da273028ea31f1274 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:34.876802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.911506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc36c9-bd88-4338-850c-154eb47dac91 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:34.953309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:34.954308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:34.954599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:34.954934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:34.955662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:34.955973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:34.957465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:34.967243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 222/450] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:34.972562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:34.999374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4daec-768a-4a76-9269-f52878024593 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:35.025171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:35.034035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:35.034717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.035010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.035289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.036131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] RBAC: Adding query filter params (group.id=e17c807e3281454da273028ea31f1274, role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:35.045136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:35.045136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:35.045136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 229/451] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/role_assignments?group.id=e17c807e3281454da273028ea31f1274&scope.project.id=0efb0b6f2f5e4422976f010f8a7444b0&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:35.085687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099ee3-47d1-478f-9971-4500df73c407 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:35.108476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:35.123112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:35.123781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.124073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.124395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.198241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:35.199690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:35.312959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 223/452] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:10:35.318617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:35.423504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba857-d471-4c99-a55a-201aa7be91cb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:35.455988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:35.456843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.457128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.457403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] PATH_INFO: `/v3/projects/b76267d843014c29925a4e096c435d8d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.458601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] RBAC: Authorizing `identity:get_project(project_id=b76267d843014c29925a4e096c435d8d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:35.460055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:35.461742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 230/453] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:10:35 2022] GET /identity/v3/projects/b76267d843014c29925a4e096c435d8d => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:35.467941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:35.488547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:35.567470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0217-1c32-4d20-9ccf-0d7b6129e806 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:35.600677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:35.601526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.601812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.602088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] PATH_INFO: `/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.603285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] RBAC: Authorizing `identity:get_group(group_id=3d7c915b0db5473a8a3f94eb2eefb46d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:35.604813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06119ca-74b0-4a69-bf00-058f466618ef None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:35.606472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 224/454] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Jul 4 09:10:35 2022] GET /identity/v3/groups/3d7c915b0db5473a8a3f94eb2eefb46d => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:35.612407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:35.670689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:35.712923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034035e-1c91-43fe-93e9-de8596247d31 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:35.745482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:35.746492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:35.746795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:35.747063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:35.747895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] RBAC: Adding query filter params (group.id=3d7c915b0db5473a8a3f94eb2eefb46d, role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=b76267d843014c29925a4e096c435d8d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:35.748212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:35.749684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905db5e-c205-46ed-9174-ae226e98718c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:35.755705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 231/455] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Jul 4 09:10:35 2022] GET /identity/v3/role_assignments?group.id=3d7c915b0db5473a8a3f94eb2eefb46d&scope.project.id=b76267d843014c29925a4e096c435d8d&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:38.249606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201638-66f0-468a-a679-012b4c4c8d85 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.250586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201638-66f0-468a-a679-012b4c4c8d85 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.251084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201638-66f0-468a-a679-012b4c4c8d85 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.252639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 225/456] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.258158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.259005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.260078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.287593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:38.289072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:38.377322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd781ee-be5a-4035-ae4c-fc913e4ce93c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.377976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd781ee-be5a-4035-ae4c-fc913e4ce93c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.378694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd781ee-be5a-4035-ae4c-fc913e4ce93c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.380495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 226/457] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.383758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 232/458] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:38.396801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.397382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.397881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.423368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:38.428265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:38.429692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:38.503481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:38.558158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beeee0-8d81-48b2-a19c-59a5af7c564b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:38.592837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 227/459] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:38.597009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:38.597998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.598450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.598898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.610633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:38.612385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:38.627175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:38.634062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:38.635837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:38.636952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:38.636952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:38.636952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:38.636952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:38.638984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 233/460] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:38.649685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:38.668365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:38.829724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777664-9804-48d9-a09a-27a1159bc813 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:38.849795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01063-b4d5-4658-82bd-04e6065427a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:38.854523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:38.888722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:38.889643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.890014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.890395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.901088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:38.902674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:38.906596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:38.907264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.907552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.907835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.908556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:38.908865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:38.910655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeae70-f274-4605-acc9-8636e3ee9cd4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ce548d6d-5887-4c78-8a20-d087f262861f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:38.922961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:38.932935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:38.934055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:38.934055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:38.934055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:38.934055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:38.934333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 234/461] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:38.934405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 228/462] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:38.934487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949b63-d585-4729-9efa-83de525455aa None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.934555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cbbd-bf0f-4606-8c80-46e4fb3130b6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.934619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949b63-d585-4729-9efa-83de525455aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.934684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cbbd-bf0f-4606-8c80-46e4fb3130b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.934747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949b63-d585-4729-9efa-83de525455aa None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.934819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cbbd-bf0f-4606-8c80-46e4fb3130b6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.934885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 235/463] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.934948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 229/464] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:38.935010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949b63-d585-4729-9efa-83de525455aa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:38.935074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba1e3-0022-4a7e-ac55-3c446516661a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:38.935074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba1e3-0022-4a7e-ac55-3c446516661a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:38.935207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba1e3-0022-4a7e-ac55-3c446516661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:38.954799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-179ba1e3-0022-4a7e-ac55-3c446516661a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:38.956196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-179ba1e3-0022-4a7e-ac55-3c446516661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:39.024700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.030073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 230/465] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:39.031212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.031506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.031788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.052281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949b63-d585-4729-9efa-83de525455aa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.053494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:39.055194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:39.097565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.097565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.097565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.097565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.097969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:39.097969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.097969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.114467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 236/466] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:39.114467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.138915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.140607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 231/467] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:39.141534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.242532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18330-c8ea-4b15-a8ca-5b1e3f8ad28f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.258638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35696-456d-41ba-9331-383d70237bc0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.280970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.281644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.281933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.282221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.282934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.284381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.292086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.299252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.304773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.304773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.304773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.310904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.312365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:39.329752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:39.330674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:39.331607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:39.331607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:39.331607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:39.331607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:39.331607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 232/468] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:39.331869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.406815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 237/469] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/users => generated 246 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:39.407585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.468296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826db76-8fd9-47e8-9c98-384bff4f34fa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.522591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.523062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.525225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.526048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.526534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.527654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.529827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.547809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171185-7ff3-4933-b10e-6e7174a83bdf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.587296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.588132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.588467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.588748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.600208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.601707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.620337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 233/470] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-76938e72-7b61-44d2-b376-34956b85df62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:39.621236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:39.622415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:39.623388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:39.623388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:39.623388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:39.623388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:39.623613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.623683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 238/471] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:39.624259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b4b1-5ff1-4dab-bffb-3c0ef669a003 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.626343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b4b1-5ff1-4dab-bffb-3c0ef669a003 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.626343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b4b1-5ff1-4dab-bffb-3c0ef669a003 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.626568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 239/472] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:39.630901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b4b1-5ff1-4dab-bffb-3c0ef669a003 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.692626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.769095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b4b1-5ff1-4dab-bffb-3c0ef669a003 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.787605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb82dd-b48e-45ce-accb-725890e62063 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:39.809393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:39.818548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.819514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.819882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.820175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.824012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:39.824012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.824012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74aa36-4d81-48db-97f0-245854a3983f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.836376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 240/473] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:39.837819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.838181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.842754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.843845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:39.844766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:39.845707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:39.846272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:39.847236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:39.847816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:39.849608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:39.862362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:39.863702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:39.872987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 234/474] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:39.874237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:39.949742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 241/475] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:39.951645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:40.005288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:40.009368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad89e1-9af7-44da-b0b3-b95e36ce35ed None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.046817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.047941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.048434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.049029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.050033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:40.051677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:40.080480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178755fe-78be-4b8e-8355-ad89a55ab8fa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.106339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:40.120354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.121280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.121565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.121854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.122628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:40.124072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:40.144390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 235/476] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:40.145500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:40.278240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 242/477] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:39 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:40.278448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db387e-0dfa-4bcf-86f5-fbf3a32ffdca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.317221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.317924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.318241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.318586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.319432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:40.320911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:40.366172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.sql.core [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:10:40.366172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:10:40.366172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [parameters: {'id': '497a3f6edf7e4c1a837278c495f54cb4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:10:40.366172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Jul 04 09:10:40.385946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return ref.to_dict() Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:10:40.386914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application yield resource Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise self.value Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application session.commit() Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:10:40.387844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:10:40.388701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:10:40.398393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:10:40.401479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [parameters: {'id': '497a3f6edf7e4c1a837278c495f54cb4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:40.403459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:10:40.405985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:40.406913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 236/478] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Jul 4 09:10:40 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:40.406989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:40.521498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fc47-69bb-4f1f-94d6-9c037bcb2391 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.562494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.563323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.563606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.563882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.575740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a8a5b30d-0263-4753-8db0-b8419ddb0ec2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:40.583981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:40.585048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:40.585909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 243/479] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:10:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:40.593100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:40.620281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:40.713322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7805-4224-40dc-b9ff-4592cc951600 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:40.751873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:40.753002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:40.753572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:40.754111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:40.755211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:40.755778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:40.757557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b075b3-ac13-44ae-a6a2-83cc396fdb82 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:40.767938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 237/480] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:41.811085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f67c6-57a2-45ed-a6f0-e9caaa9bf8e3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:41.811596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f67c6-57a2-45ed-a6f0-e9caaa9bf8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:41.811697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f67c6-57a2-45ed-a6f0-e9caaa9bf8e3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:41.813301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 244/481] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:41.818246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd004-3d69-4bd6-b94a-7a437e8b22d2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:41.818627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd004-3d69-4bd6-b94a-7a437e8b22d2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:41.818815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd004-3d69-4bd6-b94a-7a437e8b22d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:41.843223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-32ffd004-3d69-4bd6-b94a-7a437e8b22d2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:41.844442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32ffd004-3d69-4bd6-b94a-7a437e8b22d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:41.932475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 238/482] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:41.971777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f67c6-57a2-45ed-a6f0-e9caaa9bf8e3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.025508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:42.052080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43fbb-fbf6-4677-8bc3-2219aff152b3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.052386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43fbb-fbf6-4677-8bc3-2219aff152b3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.052810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43fbb-fbf6-4677-8bc3-2219aff152b3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.055112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 239/483] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:42.060959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.061305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.061562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.081894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:42.083130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:42.091144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:42.122494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f67c6-57a2-45ed-a6f0-e9caaa9bf8e3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.191674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.192474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.192761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.193040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.209713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:42.217579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:42.218530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:42.219337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:42.225609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 245/484] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:42.232753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 240/485] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:10:42.233173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.312917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.360384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:42.367806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5555-e480-4ec7-b32f-ef4541c22f28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.441153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.441840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.442127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.442458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.443704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:42.444226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:42.445947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:42.462033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 246/486] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:42.464017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.530351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9edfdb-7c70-4299-8236-3ca7cc0966ba None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.608658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e849d-6e3b-4d62-8534-c27b353a21ad None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.645727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.646578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.646865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.647276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.659755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:42.661600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:42.670916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.672118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.672639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.673107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:42.679924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:42.680756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:42.681650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:42.681650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:42.681650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:42.681650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:42.686264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 247/487] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:42.687464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.703312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a037cc95-3a03-4474-8e47-d13cec961e1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:42.711504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:42.713032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:42.713863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:42.716686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 241/488] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:42.721720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:42.721857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:42.722632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f9cb6-c9c0-40e6-9bee-dbffa861724d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.722994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f9cb6-c9c0-40e6-9bee-dbffa861724d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.723359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f9cb6-c9c0-40e6-9bee-dbffa861724d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.725686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 242/489] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:42.730485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f9cb6-c9c0-40e6-9bee-dbffa861724d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:42.827006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffa5ea-1e70-4807-842b-b2d6d3f76617 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.859698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f9cb6-c9c0-40e6-9bee-dbffa861724d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:42.871814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.872891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.873178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.873458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.874485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:42.874796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:42.876436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0b70-f9ac-4d6a-a502-f8da7543e47f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:42.897127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 248/490] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:42.897127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.897127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.897127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.906301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:42.907434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:42.907941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:42.908415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:42.909379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:42.909910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:42.911533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:42.918221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:42.919429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:42.925835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 243/491] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:42.927091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.000332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.013378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 249/492] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:43.013378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.013378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.053071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9ed0f-de11-44f6-8fb1-76ef73af4344 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.090876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.091688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.091980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.092338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.100381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.102056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-62451e15-f002-4345-b076-d4e5d8857470 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:43.121288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:43.122356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 244/493] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:10:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a875-d373-4adf-b71e-cf75c0ead032 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.123255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a875-d373-4adf-b71e-cf75c0ead032 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.123912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2a875-d373-4adf-b71e-cf75c0ead032 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.127342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 245/494] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:43.128040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a875-d373-4adf-b71e-cf75c0ead032 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.131446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833db481-664e-4d0c-a9bc-34896f87d892 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.169983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.170842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.171127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.171402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.181917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.183421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:43.201920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:43.203031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:43.203884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:43.203884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:43.203884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:43.203884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:43.203884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 250/495] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:43.204145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.243477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2a875-d373-4adf-b71e-cf75c0ead032 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.268983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.269505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.281955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.282796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.283127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.283473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.294919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-46da661c-4e9e-424f-a962-2b243da08125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:43.303905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:43.304878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:43.305679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 246/496] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:43.306868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.306868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.307146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.321414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fba3c-2934-4583-8fef-00d1e3320ac4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.325207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:43.326583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:43.356628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.357307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.357596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.357878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.358749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:43.359067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.360509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.398695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 251/497] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:43.399547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.402473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 247/498] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:43.403150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.500469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a71e-0a69-47ad-9c9a-28d08cf45f6b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.506704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e58a5-ef6b-4990-9e62-e1f1527af4f8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.514094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.521098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.535197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.535869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.536160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.536483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.537212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:43.537526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.538962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453387-c465-4fbb-9ad8-1a38348e1648 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.542219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.542894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.543172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.543448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.544185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:43.544492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.545859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.551020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 252/499] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:43.558162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4d89-629c-43f8-905d-f09d05451563 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.558162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4d89-629c-43f8-905d-f09d05451563 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.558162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4d89-629c-43f8-905d-f09d05451563 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.558162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 253/500] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:43.558162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4d89-629c-43f8-905d-f09d05451563 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.558569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 248/501] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:43.560390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.663816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4d89-629c-43f8-905d-f09d05451563 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.666570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7db-30c8-4686-b883-5ac61a749548 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.697561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.698231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.698515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.698797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.700251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.701041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.701324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.701599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.713057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:43.720795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:43.721715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:43.722549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 249/502] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:43.723215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.743391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.757519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.771455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.772924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041dbcd-782a-4d75-88f5-b86d40909f3c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.827818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d522-3766-425e-a665-d9f7d993038f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:43.863979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:43.864782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.865071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.865351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.874102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:43.875584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:43.876883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 254/503] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:43.878156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:43.878484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:43.878765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:43.891432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:43.892565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 250/504] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:43.893671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.898556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:43.899841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:43.968370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 255/505] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:43.969218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:43.978606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.988185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:43.995736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7ad-ba54-4ffc-b864-50d803f95674 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.029761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.030575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.030864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.031139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.041503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.042991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:44.060994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:44.061903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:44.062784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:44.062784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:44.062784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.062784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:44.062784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 251/506] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:44.063055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.083180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1246-7955-4e3f-b48d-fd5a6fb614d0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.119396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.120091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.120375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.120647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.121691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:44.122000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.123459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.132107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 256/507] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:44.132910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.168304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5ac-c1bc-49b4-aeaf-cfec84f127c3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.195405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.201418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.202222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.202515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.202792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.213519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.215036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.221610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:44.233159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:44.239442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 252/508] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:44.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.240838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5673515-8f65-4906-9365-1fac7f61382a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.271692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.272354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.272638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.272910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.273739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:44.274051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.276148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.293121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 257/509] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:44.293915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.345089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50597-74e2-4873-9450-003cde0bc837 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.377984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.378801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.379083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.379360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.390350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.391808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.393021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105fae-1e8d-41ea-bc66-9bc0529980ca None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:44.409348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:44.410377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 253/510] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:44.411701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.420150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.431260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.435844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.450361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 258/511] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:44.451235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.467298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.516507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55615a3-3716-4dce-a890-19b98791d448 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.549749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.550560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.550851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.551123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.551502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500561-8457-4590-a9fd-50f1a89426c9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.561748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.563230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:44.580227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:44.581257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:44.582368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:44.582368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:44.582368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:44.582368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:44.587963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 254/512] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:44.587963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.588702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.589365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.589652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.589933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.590687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:44.590999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.592375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.605152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 259/513] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:44.605895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.651148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.687233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba7ad2-9b1b-46f2-b2fe-e5981e2d8b77 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.688815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.708337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f03eb-caf5-4131-9e60-28d8292ed9aa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.722698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.723414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.723801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.724089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.743119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.743808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.744094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.744371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.745098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:44.745430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.747105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.758469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 260/514] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:44.759364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.799899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.801430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03f569-5d01-4bad-86a1-ca8fb7b658e3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:44.859553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.892237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:44.893026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:44.893313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:44.893595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:44.900520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 255/515] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:44.901365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:44.901951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:44.903446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:44.905821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:44.919571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:44.920759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 261/516] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:44.922390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.019466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15df88-14a1-4185-8acb-d8c1bf446822 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.020328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c91c0-27e3-4964-969f-7b52ad9bca5e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.052905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.053620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.053906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.054189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.060737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.062214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.062322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.063216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.063589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.063983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.065025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:45.065457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.067405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:45.076828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:45.077668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:45.078585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:45.086600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 256/517] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:45.086750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 262/518] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:45.086860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.086942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.173025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.182417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122efd5-72c2-4f9f-840c-dcb9c0ade836 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.193128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8980a7-2d02-4498-a318-61411b95a862 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.194879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.218534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.219211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.219494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.219778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.220483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.221922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.227068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.227939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.228441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.228895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.240322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.241787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:45.259934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:45.260943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 263/519] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:45.261978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.302643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 257/520] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:10:45 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:10:45.303783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.342367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.371079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15f3-4a1e-4a94-9251-df8c473ef6ba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.411228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.411922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.412212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.412497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.413364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:45.413679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.415248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.434483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c153-84bd-4512-b2dc-ddca3cb7cc9a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.435890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 264/521] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:45.439330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.454411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.472851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.473575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.473863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.474153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.474991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:45.475308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.476776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.497677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 258/522] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:45.498939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.567711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694312e-6640-4a5a-ac04-6ef5f483ec76 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.600035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.605634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.606475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.606762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.607047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.612903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026174-dbd2-475a-a9f7-e7d2f0b3a69f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.615297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.616770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:45.632122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:45.633087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 265/523] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:45.639660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.658505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.659183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.659473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.659754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.660608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:45.660927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.662341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.674290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 259/524] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:45.675131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.717273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.753202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34add-0634-4de6-b33f-01efc5192520 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.787893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989a40-a738-49c6-be45-1ffe250c8d8c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:45.791124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.791810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.792099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.792382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.827877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:45.828463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:45.828751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:45.829033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:45.829870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:45.830188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.831666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.838101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 260/525] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:45.838941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:45.875385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:45.890843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:45.894268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:45.992660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd91be9-e9dc-4883-a637-d167f35da700 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.003106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.032196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 266/526] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:46.033076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.045917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.046639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.046923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.047196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.048038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:46.048343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.049873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.101378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 261/527] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Jul 4 09:10:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:46.102288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.146574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.156763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757704-93e4-4544-8600-01e1df3149f7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.195087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.195893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.196178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.197132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.205667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.207311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:46.227104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:46.228058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 267/528] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:46.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.238772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3e88e-31d9-4536-89bc-24e292905ed9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.280165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.281130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.281415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.281694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.295072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.297135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:46.319947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:46.320889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:46.322440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:46.322440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:46.322440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:46.322440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:46.326349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 262/529] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:46.328204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.344049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.350319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fbc4-c459-41ad-adda-39ce370073f9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.395987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.396981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.397407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.397842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.425348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.439049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb95d-f9b5-452d-afc9-1daf55cdbe83 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.481064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.482621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.495690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.497525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.498116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.498591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.499808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:46.500294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.502652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.521638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 263/530] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:46.522900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.593013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 268/531] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:46.594012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.620211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.654040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.662728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08417482-07bb-4546-8c25-70184e5eb968 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.699401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.700154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.700571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.700865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.701652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:46.702076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.703779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.719931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 264/532] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:46.720911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.721666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43b3d-56f0-4a4e-b003-822b8ff2bbf7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.769271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.770248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.770961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.771868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.773171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=07a39dae9c774d8a8f4755e9a0c2596d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:46.773662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.776540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:46.784628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 269/533] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/role_assignments?user.id=07a39dae9c774d8a8f4755e9a0c2596d&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:46.786119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:46.877581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7d6c-d0ad-470a-8dcf-bc737f35644a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.937508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:46.964007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:46.964753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:46.973533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:46.973533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:46.981572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77e6a-6f3b-4fbf-b087-3009fddc396f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:46.982083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:46.983455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.002677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:47.005773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:47.006989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:47.007886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:47.007886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:47.007886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:47.007886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:47.007886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 265/534] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:47.013171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.036150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.036971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.040735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.041033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.057922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.059446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:47.093277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:47.094175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:47.095117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:47.102132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 270/535] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:47.108275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.154227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c80e7-c8c7-4298-bb8a-e310b4106f6d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.190305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.190305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.190305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.190305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.190680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:47.190680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.190998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.204928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 266/536] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:47.210149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.293966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:47.327107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f36af-2d19-4a2e-afd3-9b83d6272a8f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.376897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.377579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.377868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.378149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.378991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:47.379303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.380751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.400333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575a2c-02b7-46d3-a4f3-9716847cdc07 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.417520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 271/537] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:47.422826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.466356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.468631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.469817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.470810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.476819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:47.487275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.490885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-71bc8a60-2d82-41ca-8c56-9c633b2afb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:47.513267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:47.514364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:47.515420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:47.522014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 267/538] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:47.523605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4cba-d36b-422b-8603-e7f87094b570 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.524037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4cba-d36b-422b-8603-e7f87094b570 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.524493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4cba-d36b-422b-8603-e7f87094b570 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.526068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 268/539] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:47.527502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4cba-d36b-422b-8603-e7f87094b570 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.569802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eff73-5e78-4273-9c5a-50b5b02a9d2f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.607650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60002533-9832-4adc-978f-6c00097d251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.608377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002533-9832-4adc-978f-6c00097d251d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.608670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002533-9832-4adc-978f-6c00097d251d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.608996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002533-9832-4adc-978f-6c00097d251d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.609904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002533-9832-4adc-978f-6c00097d251d None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=0a987fcd616f48c09f4279f8dfb79740) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:47.610243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002533-9832-4adc-978f-6c00097d251d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.611746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002533-9832-4adc-978f-6c00097d251d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.618665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 272/540] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/role_assignments?user.id=0a987fcd616f48c09f4279f8dfb79740&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:47.619973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.620321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.621269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.641086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:47.642575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:47.672916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4cba-d36b-422b-8603-e7f87094b570 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.676940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:47.759809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.762314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.764159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.764644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.765672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:47.766742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.769632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:47.796688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 269/541] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:47.801874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.803880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 273/542] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:47.831099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:47.870280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:47.931694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400c669-8d3d-40c4-8b03-48bb84708bdb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:47.978239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:47.978958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:47.979247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:47.979527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:47.980380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7ed1189200a44605a751549c6045f8c5) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:47.980699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:47.982183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13eb9-b344-4673-8cdc-084252743329 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:48.002552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 270/543] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/role_assignments?user.id=7ed1189200a44605a751549c6045f8c5&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:48.015717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d5cd-14fd-4fec-a58c-bfda0cb65792 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.016327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d5cd-14fd-4fec-a58c-bfda0cb65792 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.016327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d5cd-14fd-4fec-a58c-bfda0cb65792 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.018102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 271/544] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:10:48.027153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.027479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.028176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.039196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4785e-9328-4d74-a76d-9900dc59b918 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.060780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:48.062092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:48.116979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.117812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.118159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.118999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.126678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:48.146396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:48.166831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:48.168622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 274/545] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:48.175986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.208267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 272/546] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:48.231218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.319364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:48.330270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1e9da-1aad-4717-9d63-7211dd759b39 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.374026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.374743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.375032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.375313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.376076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:48.376389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:48.377795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:48.396411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 275/547] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:48.404527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.410444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c73b4-9cfb-4ef2-8aba-b590735d1eb7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.472814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.473634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.473923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.474224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.495390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:48.510862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:48.511891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:48.512663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 273/548] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:48.518075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.538512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:48.631337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7960-6ac8-44ae-978b-ccfa475950f6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.635652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2690-f020-48b6-8a8e-e9f7adbb65de None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.675100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.675780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.676068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.676357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.677117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:48.677428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:48.678866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:48.694877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 274/549] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:48.701357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.720896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.721710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.722000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.722314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.745301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:48.748756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:48.778319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:48.779273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:48.780138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:48.780138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:48.780138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:48.780138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:48.780138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 276/550] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:48.785905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:48.798886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:48.867805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:48.906639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899833bd-a54c-4e04-82c9-b9e574d70cf4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.951305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a7ed-804f-43e2-94a3-2f2ec529e03c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:48.987215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:48.987887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:48.988227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:48.988515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:48.989250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:48.989566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:48.990977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.005062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 277/551] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:49.010435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.010598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.011260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.011552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.011840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.052518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.054049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.090843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-da6e1f64-665a-4cff-9e8c-751fc3963a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:49.098479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:49.099499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:49.100483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:49.100483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:49.100483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:49.100483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:49.100483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 275/552] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:49.101433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf66bfb-2354-43a7-818c-39545c12b7ae None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.101723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf66bfb-2354-43a7-818c-39545c12b7ae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.102001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf66bfb-2354-43a7-818c-39545c12b7ae None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.104102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 276/553] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:49.109224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf66bfb-2354-43a7-818c-39545c12b7ae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.135380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010fd6-062f-4f62-ba93-fdeb8f88be18 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.173343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.173803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.174087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.174439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.183378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.184835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3ae3be64-094d-4c27-906a-e233de5edebb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:49.200425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:49.201406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:49.202932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 278/554] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:49.208182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.208740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.209240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.232161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf66bfb-2354-43a7-818c-39545c12b7ae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.235648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:49.236804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:49.264558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.270487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.271500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.277961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.277961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.277961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:49.277961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.277961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.293678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 277/555] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:49.294873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.317105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 279/556] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:49.318331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.378969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.421930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2dc71-fbab-4680-93ca-e687bd589efb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.428446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89eb66-3c59-4187-ad59-b39a0c4277e8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.458561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.459413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.459689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.460041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.460952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:49.461350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.463453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.468137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.469148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.469606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.470075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.478123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.479853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.486168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 278/557] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:49.486168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:49.500226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:49.501662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:49.502679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:49.505309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 280/558] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:49.506329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.546598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.591569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a4466-f912-4ca6-bd71-35ac5e5f989c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.611576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8b243-1b18-4c68-9dc0-ef1f0f82301f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.627682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.629029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.629914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.630251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.630860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.642712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:49.650714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:49.651715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:49.652626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:49.653911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.654817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.655296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.655761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.656251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 279/559] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:49.657157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.729542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.731255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.785091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f21b-66a2-4de1-b530-193bb3aab56e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.800162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.835227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.835918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.836209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.836491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.837384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:49.837705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.839505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.841766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 281/560] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:49.842720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.857836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:49.864293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 280/561] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:49.865498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:49.944711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817c6e-bd7c-4620-b9c4-b946323b71a3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.976425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb9d6-af75-46b9-ad94-3cf6cfb00616 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:49.980082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:49.980692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:49.980974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:49.981249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:49.981993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:49.982331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:49.983699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:49.997331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 282/562] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:49.997331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.021679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.023077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.023684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.024194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.036206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.038189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:50.058695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.060091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 281/563] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.060973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.083973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.086103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.105913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae16d-5917-41c6-891f-96f5ad63198d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.143533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.144330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.144668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.144953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.157643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.159159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.165596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bb622-f8c5-4bc1-8d6a-888ad385cf4c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-71b70f1b-89db-4b89-be9a-44d589f3489c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:50.177042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.177997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.178927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:50.178927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:50.178927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.178927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:50.178927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 283/564] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.179959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849436-070d-4eea-a5e8-ea7eeac81229 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.179959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849436-070d-4eea-a5e8-ea7eeac81229 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.180135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849436-070d-4eea-a5e8-ea7eeac81229 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.182040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 284/565] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:50.186379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849436-070d-4eea-a5e8-ea7eeac81229 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.216135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.216943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.217226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.217502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.229968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.231772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:50.251480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.252393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 282/566] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.258582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.294290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849436-070d-4eea-a5e8-ea7eeac81229 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.320481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.329087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.329814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.330132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.330468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.331259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:50.331638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.333400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb0f93-8ba0-4607-b430-8d39e61e20c3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.346206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 285/567] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:50.347436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.347725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.348004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.349168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e45b1-9d79-4ef2-b692-125619446a13 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.364502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:50.365701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:50.387835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.388683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.389054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.389415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.390283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:50.390622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.392120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890e9b-0b76-4af3-a3a8-3cc26be21dc6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.404820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 283/568] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:50.406438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71fc2-71e0-4193-9d7b-ccd4813d3bf1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.406766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71fc2-71e0-4193-9d7b-ccd4813d3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.407094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71fc2-71e0-4193-9d7b-ccd4813d3bf1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.408485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 284/569] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:50.410051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71fc2-71e0-4193-9d7b-ccd4813d3bf1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.436205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 286/570] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:50.437315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.513432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71fc2-71e0-4193-9d7b-ccd4813d3bf1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.540680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc48ab8-2b88-4ba2-91b2-751048bd8cd1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.546389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.547056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.547344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.547630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.548350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:50.548664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.550041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.561544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 285/571] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:50.562385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.573820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.574644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.574936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.575214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.581818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.583290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-617b5104-401c-4980-9057-5dfa3166d08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:50.597321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.598216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:50.599123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 287/572] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.599985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.600092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.600367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.616911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:50.618141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:50.635188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.664174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979beb55-fb4b-43c9-a33a-411466efe6f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.684945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 288/573] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:50.685788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.697997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.698847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.699133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.699415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.706541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.707686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:50.721949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.729138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 286/574] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.730374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.786126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab150b-ccbc-49fe-91ac-3b933adf277d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.790421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.822995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.823618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3684-70f5-490c-a0f6-cf7a96ae9e2d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.823850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.824120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.824487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.834960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:50.841526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:50.843193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.850121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 289/575] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.851540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.864156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.865043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.865332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.865637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.873579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.875072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:50.889592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:50.890642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 287/576] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:50.891613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:50.944701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.953632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4881c-5114-446c-87cd-2114452e753a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:50.973126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:50.987689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:50.988350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:50.988637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:50.988947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:50.989737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:50.990052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:50.991525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:50.993626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edaac2-1273-419f-a83c-7fe170948002 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.004767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 290/577] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.005584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.020213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.035937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.036746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.037509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.037794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.038073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.049261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:51.057103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:51.059333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 288/578] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:51.060552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.112999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ff555-bfd3-478b-babf-d812b68fd0bd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.166724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cbf46-ac87-48f4-acf8-7ca1d8e24e2d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.168891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.169555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.169843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.170124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.170943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:51.171259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.172688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.184105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 291/579] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.184916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.202969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.203644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.203931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.204213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.204973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:51.205272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.206700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.216535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 289/580] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.216535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.261526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.292168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.304152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cbd5d-82b8-4df6-8d45-29211f8c22bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.335451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007909f-8673-41ce-b825-b8495cbe720a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.338938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.339639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.339927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.340206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.341039 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:51.341350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.342837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.364291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 292/581] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.364291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.370060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.371008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.371299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.371580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.372407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=ab9bf3dd7ae04319987bd7a26c94ed20) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:51.372727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.374163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.379937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 290/582] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/role_assignments?user.id=ab9bf3dd7ae04319987bd7a26c94ed20&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.380703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.484681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f22f2-9d75-4814-a746-a5aeabe99b7d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.492585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.498302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54114dd-ab63-40cc-9eb2-8a5c965654e3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.523488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.524231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.524525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.524809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.525609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:51.525925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.527388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.535750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.536696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.541719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.541882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 293/583] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:51.541969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.542043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.554803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.558135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=b0991f43889c4092baff1a5a1099d673, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.559717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.648607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c224dc7-cac4-4d84-bea7-5d832f86807e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.669374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 291/584] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:51 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:51.670812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.695815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.697125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.697424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.697759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.715649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.717459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:51.743747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:51.744717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:51.745911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:51.745911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:51.745911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.745911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:51.752543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 294/585] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:51.753752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.802374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314f64-f653-4461-a1e2-1b16785a5ee3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.821814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.853666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.854849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.855137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.855416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.866324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.867859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.873568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ec43-bf5f-4edc-b6d4-792a8c35d5db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:51.878588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:51.894090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:51.895083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:51.896011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:51.896011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:51.896011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.896011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:51.896011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 292/586] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:51.897759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:51.927795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:51.928605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:51.928888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:51.929163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:51.945228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:51.947661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:51.969894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:51.970878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:51.971774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:51.971774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:51.971774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:51.971774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:51.974275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 295/587] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:51.975290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.027285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39ea5-664a-4365-b6c2-c8c32e152deb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.065249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.066720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.067220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.067678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.068611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.069102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.070727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.083432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 293/588] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.084414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.110864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85996ab-12a7-4d27-97cb-7c0474b5d8bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.154830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.169163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.179712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.180639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.181058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.181492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.182405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.182855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.184372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.197461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 296/589] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.198589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.212799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578ff7-ed88-426c-9721-fbbce3a85f03 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.253162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.254020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.254442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.254823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.255760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.256114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.257645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.270926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 294/590] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.271948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.322256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf656e-6546-4b52-b7cf-ad55b4c331ba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.360329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.361351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.361871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.362430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.370938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.372668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.379363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a26843-6c20-4da1-be6a-09a6fb5971aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:52.388930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:52.390053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:52.391240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:52.393282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 297/591] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:52.394343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.405280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.420134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.421092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.421491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.421878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.429540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.429819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.431395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:52.447351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:52.448471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:52.449595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:52.451658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 295/592] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:52.452919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.511028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da60d7-6421-45ff-87ec-eeef38301a95 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.551452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.552634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.553061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.553480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.561518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.561852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a7e2-20f4-4863-b15e-c8a964dddc52 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.566232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:52.583635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:52.584816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:52.585846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:52.588463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 298/593] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:52.589691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.600553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.601374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.601768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.602187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.603227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.603646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.605233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.623778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 296/594] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.624753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.667553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.691955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.701733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698031-2f4a-4227-bd81-7474645c599c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.730420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133b98-43f0-4ebc-8dba-c61c9da0a683 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.739210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.740093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.740610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.741040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.742029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.742591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.744703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.762400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 299/595] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.763610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.770650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.771503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.771864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.772238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.773192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:52.773577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.775241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.794099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 297/596] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:52.795044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.884262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb3adf-8996-41a9-bbc0-eb75e27c1f92 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.895045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:52.901292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d8220-da16-4fae-9759-8839675f30f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:52.922413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.923443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.924128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.924974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.937274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:52.938208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.938347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:52.938720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:52.939084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/07a39dae9c774d8a8f4755e9a0c2596d/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:52.940279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.955595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=07a39dae9c774d8a8f4755e9a0c2596d, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:52.957173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:52.960184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:52.961173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:52.962297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:52.962297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:52.962297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:52.962297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:52.963917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 300/597] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:52.964852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:52.968999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.069350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 298/598] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:52 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/07a39dae9c774d8a8f4755e9a0c2596d/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:53.070561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.072661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8a78-478d-479b-8268-4ef9c8937552 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.115774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.117573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.118793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.119286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.134168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.136457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:53.159339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:53.160726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:53.161689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:53.161689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:53.161689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:53.161689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:53.164360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 301/599] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:53.170570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.244118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.299359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f664c-d869-446e-bddd-6f12d127bde7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.327959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd911-89db-497b-a616-81c115babfc3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.343934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.345526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.346372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.346886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.348208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:53.349265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.351478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.371804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 302/600] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:53.373153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.373828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.374116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.374426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.375159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:53.375475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.376715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.376901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.391578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 299/601] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:53.404402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.417296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.498032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2899-fbef-4984-a775-a9a0c1caf96e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.530728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.535849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ed09-5fad-48a4-b4df-d33416679657 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.542772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.543920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.544996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.545488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.556076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.557889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.573397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.574210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.574517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.574792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7b1d289b-4819-4852-aa72-1ab51f43d4e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:53.579190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:53.580086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:53.580985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:53.583304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.584025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 303/602] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:10:53.584841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.585955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db798-b98a-4f98-9b2b-d4defa5e566e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.587021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db798-b98a-4f98-9b2b-d4defa5e566e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.587831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db798-b98a-4f98-9b2b-d4defa5e566e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.590217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 304/603] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:53.591210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db798-b98a-4f98-9b2b-d4defa5e566e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3f442acd-f510-4f04-9b33-92781f7f0aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:53.605883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:53.606878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:53.607776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 300/604] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:53.608731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.608943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.609227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.633420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:53.634745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:53.719003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db798-b98a-4f98-9b2b-d4defa5e566e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.726931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.738645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 301/605] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:53.739781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.777198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.777864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.778155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.778466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.779337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:53.779642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.781277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.800375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 305/606] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:53.801380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.846495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:53.863097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d8d9-c32b-4a02-95ef-b07c690bf656 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.902769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.903448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.903730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.904323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.904788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:53.905103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:53.906571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:53.923532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 302/607] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:53.923743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac29c9-b6f2-44a4-ab34-ff5146bfb42d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:53.923842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.959566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:53.960656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.961126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.961461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.972807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3c634425-a148-4b74-b34b-ee0ad88fda23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:53.980614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:53.981650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:53.982535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 306/608] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:53.983320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f24e-e9da-40a7-9d68-6a01cf0eacf3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:53.984146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f24e-e9da-40a7-9d68-6a01cf0eacf3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:53.984146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f24e-e9da-40a7-9d68-6a01cf0eacf3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:53.989048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 307/609] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:53.989048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f24e-e9da-40a7-9d68-6a01cf0eacf3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:53.994895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.059038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b9ad3-ef5a-4ad2-907f-9405cf7c23a2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.096651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.097549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.097826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.098124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/7ed1189200a44605a751549c6045f8c5/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.100909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.107929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f24e-e9da-40a7-9d68-6a01cf0eacf3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.113729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=7ed1189200a44605a751549c6045f8c5, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.115268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097a05-f8d9-4a4b-9700-3c60d5b7dc1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:54.141911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.142928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.143281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.143708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/0a987fcd616f48c09f4279f8dfb79740/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.159883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=0a987fcd616f48c09f4279f8dfb79740, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.161154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:54.215001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 303/610] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:53 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/7ed1189200a44605a751549c6045f8c5/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:54.216287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.216581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.216859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.243932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:54.246569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:54.252876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 308/611] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:53 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/0a987fcd616f48c09f4279f8dfb79740/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:54.252876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.344130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 304/612] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:54.383335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.433366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.444250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0bfd8-d6e4-4634-8d9d-9441961e916a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.497387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.498133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.498566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.498912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.499769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:54.500143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.502166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:54.516814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 309/613] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:54.518296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.520934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc06e-54a3-4817-ab4d-b1f042def639 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.535787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.585599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.587409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.587935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.588427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.606377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:54.615917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:54.616932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:54.617879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:54.620960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 305/614] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:54.631842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.713310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a869e-3d55-487c-adeb-78cec6911683 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.749268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.749983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.750320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.750586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.763855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.765413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:54.785904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:54.786922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:54.787836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:54.787836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:54.787836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:54.787836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:54.787836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 310/615] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:54.793753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.826876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.836032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c772-fbfb-40f8-bd72-0c4575c972a0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.882694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:54.909154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.909890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.910185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.918640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.919464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:54.919781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.921185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:54.935533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c1187-8e63-43ec-b258-4f6df0b878be None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:54.939133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 306/616] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:54.943593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:54.976461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:54.978049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:54.978778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:54.980211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:54.982145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:54.982878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:54.985863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.006747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 311/617] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:10:55.012041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.168899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94ad1-3e3a-4af4-b4e8-522e80467f84 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.193989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.200373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e183-6c6d-474a-8487-1eca2eca0e4c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.219088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.219946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.220163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.220434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.233693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.238612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.265095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.265823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.266111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.266415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:55.267076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:55.267998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:55.269112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 312/618] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:55.279235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.281548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.283482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:55.323975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:55.324945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:55.325830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:55.325830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:55.325830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:55.325830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:55.327881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 307/619] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:55.333424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.360059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.429918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd773-a50b-489f-a177-ece79ff8dd02 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.475248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.477826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.478534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.480060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.481133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:55.481837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.484370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a88c1-6c5a-4b1d-a0cf-5929e4629bc1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.516007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 313/620] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:55.517734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9db5-cf9b-45b9-9bf9-f4fbf6aa9f20 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.518281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9db5-cf9b-45b9-9bf9-f4fbf6aa9f20 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.518838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9db5-cf9b-45b9-9bf9-f4fbf6aa9f20 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.520629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 314/621] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:55.521607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9db5-cf9b-45b9-9bf9-f4fbf6aa9f20 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.549833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dccc1a-1970-4428-b5df-285886b09e5d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.569540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.587870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.588573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.588864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.589147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.589915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:55.590403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.591733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141664d6-2b77-45d4-892f-382952935b33 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.604598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 308/622] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:55.606034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.606361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.606655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.628224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:55.629560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:55.647629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9db5-cf9b-45b9-9bf9-f4fbf6aa9f20 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.687724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.688950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.689567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.690146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.696761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.704096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.706083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.710332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 309/623] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:55.711273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:55.727407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:55.729268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:55.730259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:55.730259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:55.730259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:55.730259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:55.732037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 315/624] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:55.738361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.846938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:55.849952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d844154-ee89-4488-98af-2ca037c7491a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.856608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f35f-5773-41fa-ada9-50bac488c15c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:55.896335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.896806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:55.897004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.897293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.897570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.897971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:55.898336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:55.898462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:55.898650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.898971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:55.900051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.906978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:55.908562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:55.918522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 316/625] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:55.919776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:55.926809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:55.927795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:55.928731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 310/626] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:55.929318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:55.993571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.037775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093365a0-f5d1-41f2-b51c-e7b5a473572f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.059521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e740-0e67-404c-89fe-d72ac792ec6d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.082959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.084258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.085146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.085744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.095824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.096522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.097506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.097839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.098093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.098323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.110451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:56.115817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:56.116915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:56.118066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:56.124669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:56.125691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:56.126577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:56.127654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 311/628] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:56.128046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 317/628] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:56.128859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.129078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.144551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.248170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2b44-abd7-495b-8ae7-8e269f3bb5c2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.273242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4753112-e161-4d69-80a9-2373a4fc275c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.295153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.299090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.300296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.301003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.301434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.302569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:56.303326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.305443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.310751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.311558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.311958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.312380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.313337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:56.313764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.315532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.326935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 318/629] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:56.327665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.344972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 312/630] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:56.344972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.425510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.452228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bea15-660e-4fa4-8a15-171261353680 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.472745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b35af3-7309-430f-8106-3f41ae820e44 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.490974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.491930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.492218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.493044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/ab9bf3dd7ae04319987bd7a26c94ed20/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.514940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=ab9bf3dd7ae04319987bd7a26c94ed20, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.516402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997474-5286-4755-887e-5d7b6fe32e29 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.518830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.520259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.520866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.521353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.522392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:56.522971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.524623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.533845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 319/631] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:56.534946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.582120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 313/632] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:10:56 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/ab9bf3dd7ae04319987bd7a26c94ed20/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:10:56.583599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb841-16cd-44fe-970f-42012e80e5ad None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.583877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb841-16cd-44fe-970f-42012e80e5ad None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.584160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fb841-16cd-44fe-970f-42012e80e5ad None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.585579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 314/633] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:56.586175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fb841-16cd-44fe-970f-42012e80e5ad None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.625519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.651180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64434-b878-4482-87d7-aa439a7cf582 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.683983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.688802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.689467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.689829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.690040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.712926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fb841-16cd-44fe-970f-42012e80e5ad None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:56.757150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:56.758859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.759149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.759428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.770733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.772198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.773598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:56.775196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb88f-f73c-49a4-9097-219cf9fd16de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-766f626f-7a2f-454c-8208-4d63cbaaeef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:56.790827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:56.791795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:56.793022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:56.793022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:56.793022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:56.793022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:56.793022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 315/634] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:56.793511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e337fe-73bf-4804-aba7-7ef9e0c867af None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.793584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e337fe-73bf-4804-aba7-7ef9e0c867af None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.793842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e337fe-73bf-4804-aba7-7ef9e0c867af None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.798248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 316/635] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:56.798248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.798248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.798248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.814910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:56.816108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:56.894507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 317/636] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:56.894507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:56.902742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 320/637] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:56.902742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:56.902742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:56.902742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:56.911830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:56.927097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:56.928521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:56.958068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.004228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 321/638] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:57.004897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.008978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07974be-6e92-419e-aa3e-acb2897f55ae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.056366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.057399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.057910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.058419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.059379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:57.060004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.061661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.077660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 318/639] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:57.078707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.116614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d44d-ca0b-47f1-b0c5-007ede29c106 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.153503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.154679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.154972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.155256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.156928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.166765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.168243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:57.186479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.187416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.188385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:57.188385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:57.188385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:57.188385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:57.192256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 322/640] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.193104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.194659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecfdc-ddda-4445-bf2a-c4715b5b3e37 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.210662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.239555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.240331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.240663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.240896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.252610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:57.260311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.261290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:57.262133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 319/641] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.262870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.311137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d16fba-632d-4400-9d55-4dba008d3ad3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.348508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.349550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.350043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.350563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.361849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:57.368525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a66b-97b4-4a39-b93e-78c2573f96f6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:57.372035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.373231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:57.374324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:57.376522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 323/642] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.377570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.401175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.407079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.407881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.408164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.408438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.415893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.417331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:57.431811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.433008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 320/643] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.434016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.464421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.491128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217d42-da0e-4682-a4d3-48afe3b56b48 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.526934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.527606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.527893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.528221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.528958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:57.529274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.530708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.542791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 324/644] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:57.543605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.557104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3145a-c95d-4444-8972-70992c91dbd4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.592021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.592762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.593046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.593321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.594063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:57.594425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.595778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.605111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 321/645] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:57.605820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.657735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ea73-c2ca-4041-ba3e-57f79b4759fc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.661554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.693858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.694575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.694861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.695143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.696434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:57.696747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.698134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.699780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.707816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 325/646] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:57.709756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.719559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34548-71c7-420e-b941-8b3ea9009556 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.754539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.755215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.755510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.755787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.756629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:57.756941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.758945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.782032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 322/647] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:57.782032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.823728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8629422-993b-49f9-a8fa-bee2681999fb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.859285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.860369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.860660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.860991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.869758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.872070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:57.891211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.892448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:57.899362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 326/648] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.899983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d0802-f870-4167-a62d-64a7d5a1fb60 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:57.900075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:57.905804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.929025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:57.929925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:57.930309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:57.930657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:57.944656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:57.946786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:57.964952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:57.965270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:57.966284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:57.967378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:57.967378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:57.967378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:57.967378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:57.968461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 323/649] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:57.969114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.018735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3606-7540-4ebd-89be-90bd439c4a5e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.054810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.056120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.056400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.056675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.067534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.068982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.079030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b079c-3149-428b-9924-beecd04d87a5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:58.090365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:58.091400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:58.092425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:58.092425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:58.092425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:58.092425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:58.097674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 327/650] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:58.097674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.120426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.121650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.121772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.122098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.155131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.198080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.199657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.205783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786a4cf-38d4-485c-958d-35858201212d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.215827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.244922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.245858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.246141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.246443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.247286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:58.247838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.249048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.262118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 328/651] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:58.262958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.317672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 324/652] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:58.319386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.368634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55146-ada9-4e24-8a33-b37c2b7aeaf9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.387649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.404827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.405589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.405780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.406038 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.406946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:58.407119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.408464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.421600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 329/653] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:58.422262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.436522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ded8e-15a6-4747-b2ef-11bd0868f39e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.452936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.472832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.473498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.473791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.474061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.474814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:58.475124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.476497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.488873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 325/654] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:58.488873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.541753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd17c3-406c-45c6-ac40-12807d4f1482 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.578580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.579333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.579622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.579903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.580735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:58.581050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.582535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.589344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 330/655] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:58.590285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.614622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4295d-73e3-4350-94ca-78b0bc3520e6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.644210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.657745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.658709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.658999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.659277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.672563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.674783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:58.695782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:58.696775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:58.697686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:58.697686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:58.697686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:58.697686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:58.697686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 326/656] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:58.697973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.709684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.719786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c0589-6974-4807-9f13-25b94edd6d2f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.764957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.765877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.766282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.766628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.775709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.777170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-eb71ef9a-33a9-44aa-97b9-e98066a0b4bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:58.792492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:58.793612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 331/657] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c09c-59b3-44ce-baef-b5833c41215d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.795439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c09c-59b3-44ce-baef-b5833c41215d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.796153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c09c-59b3-44ce-baef-b5833c41215d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.796979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 332/658] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:10:58.797516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86c09c-59b3-44ce-baef-b5833c41215d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.820229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c5a04-f89e-464e-8f75-ad717fad78d4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.863512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.864152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.864442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.864724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.873002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.874486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:10:58.889719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:58.890746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:58.891683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 327/659] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:58.892281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:58.918789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86c09c-59b3-44ce-baef-b5833c41215d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:58.930033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:58.956955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:58.957627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.958107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.958428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.959163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:58.959480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:58.960871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad452f-816f-443c-8f3a-fecbc9adaf51 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:58.974525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 333/660] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:58.980556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:58.980854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:58.981139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:58.997830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:10:58.999065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:10:58.999205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab14a79-749d-4b4d-a8a9-171d5f9a6d4c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.007364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.035254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.035934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.036226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.036513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.037397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:59.037725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.039843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.061821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 328/661] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Jul 4 09:10:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:59.062685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.074696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 334/662] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:10:59.075597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.165200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.176730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3c5af-62c9-42cd-a4cb-4b516e31196a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.183931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c678339-af25-4036-97b6-0a7d37818609 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.217989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.219049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.219543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.220026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.221072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:59.221636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.222492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.223289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.223571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.223846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.224223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.233509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.235010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.247777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 329/663] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:59.247777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:10:59.249127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:59.249997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:59.250952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 335/664] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:59.251441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.257718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.359824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e81be5-4144-4945-b119-dd19f59453f8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.362089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc396e-a816-4293-86b1-0a8363ba3a61 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.395529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.396898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.397180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.397556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.400547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.401469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.401760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.402041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.409175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:10:59.417117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:59.418096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 336/665] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:59.419679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.425345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.482522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.483791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.485415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.525915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210ede4-e145-4495-8b67-6655631efb81 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.563210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.564113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.564403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.564708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.604418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 330/666] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:59.605718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.639902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.641477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.661843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.708320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.715030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5147-c335-4fdd-a31a-37cf15b9b599 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.755282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 337/667] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:10:59.755282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.757803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.759078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.759356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.759640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.760434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:59.760743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.762217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.779724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 331/668] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:59.779724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.862213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d90f0-c3b4-407e-a140-f45b5edd687c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.887440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269b51-d51f-466c-8e82-aadac8f30caa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:10:59.897982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.899971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.900644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.901093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.901381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.902136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:10:59.902496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.903879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.912196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 338/669] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:10:59.913044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:10:59.926901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:10:59.927694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:10:59.927981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:10:59.928248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:10:59.938626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:10:59.940067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:10:59.942239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:10:59.958062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:10:59.959074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 332/670] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:10:59.965440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.031470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c625a7-48ae-4929-9664-7bd13cf8ed56 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.068516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.069310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.069592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.069867 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.070255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b33781-32ad-464c-98b1-4e5ba8921c27 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.080919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.085452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:00.101074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:00.102106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:00.103062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:00.103062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:00.103062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:00.103062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:00.103062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 339/671] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:00.103343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.112418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.113141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.114097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.114097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.114632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=07a39dae9c774d8a8f4755e9a0c2596d) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:00.114972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.116395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.124041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 333/672] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:10:59 2022] GET /identity/v3/role_assignments?user.id=07a39dae9c774d8a8f4755e9a0c2596d&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:00.127107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.175840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.196348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.234593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946748b1-20cd-4927-b4d5-889ac4cedf6c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.274759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.275617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.275908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.276189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.288090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.288425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065dc25-e195-4e10-9ebd-0ab6e5ab3f20 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.289635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:00.311283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:00.312223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:00.313130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:00.313130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:00.313130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:00.313130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:00.316305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 340/673] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:00.317198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.328766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.329442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.329734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.330017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.331161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:00.331286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.332605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.345063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 334/674] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:00.345754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.439502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802272aa-ff1f-4a5f-9e86-43d244fc1318 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.456603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.476684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.485966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c5041-ff98-40b5-abaa-67d428204ecd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.486517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.487254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.487618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.487972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.488796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:00.489186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.490735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.510378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 341/675] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:00.512372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.527817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.528983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.529322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.529618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.530824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:00.531150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.532950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.550366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 335/676] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:00.551537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.634965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f5db0-5eb1-4d3b-a0bf-fc65f1b478f2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.667557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab1ae-6047-48ac-b86c-34e698b3ade0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.671343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.672149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.672436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.672712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.680904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.682463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:00.697683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:00.698697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:00.699595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:00.703767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 342/677] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:00.704615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.710370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.711497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.711992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.712492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.722551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.724036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:00.740162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:00.741060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:00.741949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 336/678] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:00.743608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.752605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.764411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:00.819388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c734-ed23-4014-802f-83aedbf27cc2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.852067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec917-0fb2-4a4f-855e-3dc363ff3b7b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:00.858769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.859989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.860282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.860560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.869804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.871560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5004842f-4191-47bd-b915-35cd03527e40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:00.886049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:00.887149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:00.888095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 343/679] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:00.888681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022940d4-6b4d-47ac-90a7-b9646a00e933 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.888749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022940d4-6b4d-47ac-90a7-b9646a00e933 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.889367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022940d4-6b4d-47ac-90a7-b9646a00e933 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.893551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:00.894313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 344/680] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:00.894482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:00.894739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:00.895024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:00.895116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022940d4-6b4d-47ac-90a7-b9646a00e933 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.895924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:00.896201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:00.897645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:00.910169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 337/681] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:00.911038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:00.990648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.019641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022940d4-6b4d-47ac-90a7-b9646a00e933 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.027289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287e1f-9bef-414b-900c-a2b5cd03adb7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.030140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.057076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.057731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.058021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.058336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.059130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:01.059443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.061036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7eb27-58a5-4ee9-9885-855f61552fda None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.063580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.064261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.064552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.064835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.065685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:01.066003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.067492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.079492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 345/682] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:01.080856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.081223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.081580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.089825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 338/683] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:11:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:01.091506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.098930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:01.100318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:01.173095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 346/684] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:01.173943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.217638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92213f8-8b74-480d-b732-3bbfc59a2407 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.247267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.258504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.259176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.259463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.259744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.261216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=0a987fcd616f48c09f4279f8dfb79740) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:01.261216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.262676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.278226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 339/685] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/role_assignments?user.id=0a987fcd616f48c09f4279f8dfb79740&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:01.278226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.299183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.304416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a92b5-cbcd-41a7-ac59-8e23536197dd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.360757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.361446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.361736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.362624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.363515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7ed1189200a44605a751549c6045f8c5) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:01.363835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.365752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.375065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 347/686] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/role_assignments?user.id=7ed1189200a44605a751549c6045f8c5&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:01.376031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.391340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee32a4-b185-480f-afb3-6771ba1614b5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.465189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.465897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.466150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.466455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.549261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571a99-525b-432f-be3a-237a0e0b2f77 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.563809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.587463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.589138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.604349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.605406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.606084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.606464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.620961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:01.628841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:01.629994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:01.630909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 348/687] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:01.639217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.671781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.726224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 340/688] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:11:01.732723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.765718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a479aca-5472-495a-9702-965a5d7b1064 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.803817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.804416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.804788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.805071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.805965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:01.806164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.807612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.820866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 349/689] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:01.822125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:01.829232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.842867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4c98-87de-43bc-b663-2f4333b11ec3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.914576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:01.915396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:01.915675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:01.915945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:01.942500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:01.943982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:01.959267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:01.976118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:01.977654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:01.979004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:01.979004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:01.979004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:01.979004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:01.979004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 341/690] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:01.989691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331d34-2d0b-42ea-adb3-2483638e0bc5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:01.992224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.061301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.062030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.062357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.062637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.083367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.085682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:02.107744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:02.108728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:02.109647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:02.109647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:02.109647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:02.109647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:02.109647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 350/691] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:02.119276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.151186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcd7f-3781-4d5f-a8a8-f9442adb07ea None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.193321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.193926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.194225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.194516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.195791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:02.196107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.197547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.217934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:02.224188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 342/692] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:02.231333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.338031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167850c6-a1ca-403a-a479-dfd8915d98d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.401638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef7bd7-7183-49e8-96ca-602e568216b1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.435857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.436538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.436822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.437100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.437834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:02.438141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.438437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.439240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.439531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.439651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915528f6-ef1a-4409-b5a3-e8df3ca70517 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.439820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.443028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:02.450105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.452517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.458284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 351/693] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:02.459882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d857-bfb3-4925-9edd-2d653b379242 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.461826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d857-bfb3-4925-9edd-2d653b379242 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.462106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d857-bfb3-4925-9edd-2d653b379242 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.463604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 352/694] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:02.464870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d857-bfb3-4925-9edd-2d653b379242 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-df1f1594-9882-412f-b54e-2a4120a75011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:02.478107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:02.479653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:02.480781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 343/695] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:02.481279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.481279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.481402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.503924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:02.505195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:02.580137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:02.599931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 344/696] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:02.599931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.600267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d857-bfb3-4925-9edd-2d653b379242 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.652631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.653704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.654131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.654579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.664922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.667202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:02.690542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:02.691586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:02.692752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:02.699784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 353/697] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:02.700942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.725355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb4ee-9aee-4125-a526-e8da3b3b6a16 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.765248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.766506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.766948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.767372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.768949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:02.769609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.771650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.776165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:02.789597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 345/698] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:02.791443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.812296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07e80-72e4-470e-9d4d-833300c00810 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.852606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.853386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.853814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.854210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.861095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:02.867117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.869087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:02.889382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:02.890537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:02.891642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:02.891642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:02.891642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:02.891642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:02.897767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 354/699] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:02.899007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:02.928257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe883e1-fb07-48fa-8b29-02f14d85ac94 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:02.974755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:02.975682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:02.976888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:02.977313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:02.979116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:02.982536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:02.984770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.014489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 346/700] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:03.015582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.017847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2d64b-37a8-4e59-aca2-72f1de7fc976 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.031109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:03.064171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.065258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.066046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.066510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.068158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=ab9bf3dd7ae04319987bd7a26c94ed20) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:03.068623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.071086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.079270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 355/701] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:02 2022] GET /identity/v3/role_assignments?user.id=ab9bf3dd7ae04319987bd7a26c94ed20&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:03.080963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.131150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296500a-fe56-4157-8761-cbf0ed3e3124 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.143883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:03.172778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.174070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.174593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.175080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.177250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:03.177831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.179604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.194793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 347/702] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:03.200680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.213771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ae72-afb6-416e-ac5a-579802bd138a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.258079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.258760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.259041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.259316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.309466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:03.341455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.343012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.387903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d054eb-ab52-40ff-8838-b53ac3958bb2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.435469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.436537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.437060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.437547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.438525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.443214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.471145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 356/703] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:11:03.477190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.542546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 348/704] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:11:03 2022] POST /identity/v3/users => generated 254 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:03.568065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:03.604836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e626fb-dda5-43d1-8459-1e2c81727561 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.647788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.649081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.649366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.649641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.663565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.665095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-60cab37a-0ac7-4733-9690-bf5857b8c3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:03.685449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:03.686485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:03.687385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:03.687385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:03.687385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:03.687385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:03.691382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 357/705] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:03.692960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.728970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:03.809016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494864-8a6e-4582-9999-cfa10f733e0b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.809357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494864-8a6e-4582-9999-cfa10f733e0b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.809571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4494864-8a6e-4582-9999-cfa10f733e0b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.814860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 358/706] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:03.817499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.817787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.818064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.823610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab252a8-8844-476c-87bb-28c436ead4dc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:03.835835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:03.837198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:03.863212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:03.863896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:03.864187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:03.864473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:03.865216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:03.865528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:03.867084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:03.881134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 349/707] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:03.887601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:03.925628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 359/708] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:03.949140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.002222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.020822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.023907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6215d-02c3-4aa8-9fe6-2b031eeb98db None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.068147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.069113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.069721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.070733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.072863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ffc9-2e73-4276-9839-5f02839d862b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.079685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.081656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e7a71bbc-1ed3-4798-93a4-46ce800b180c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:04.101700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:04.102725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:04.103632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:04.104721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 350/709] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:04.105285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9fb1-1212-42b7-b0f3-c7b56acb3720 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.105589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9fb1-1212-42b7-b0f3-c7b56acb3720 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.105865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec9fb1-1212-42b7-b0f3-c7b56acb3720 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.107442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 351/710] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:04.109155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec9fb1-1212-42b7-b0f3-c7b56acb3720 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.114517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.115350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.115639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.115922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.116591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.118602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3f7a827c-5ebb-4963-bfe8-f6d5f004fbeb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:04.134737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:04.135914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:04.136786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 360/711] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Jul 4 09:11:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:04.137641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.138009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.141695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.157881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:04.159162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:04.241495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 361/712] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:04.246810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.249436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec9fb1-1212-42b7-b0f3-c7b56acb3720 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.291798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.292728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.293088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.293704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.294866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:04.295187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.297099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.313869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 352/713] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:04.315190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.317114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.319214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.378536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b69f22-ff3d-44d9-ae90-726e695fd23f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.425984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.426765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.427071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.427339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.428391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:04.428707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.431360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.437301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 362/714] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:04.439464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1553-0d43-4aeb-b5a2-4d82aee9c4cd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.440487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.479209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.480400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.480888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.481369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.482310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.483951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:04.498745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:04.499819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:04.500659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:04.508643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 353/715] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:04.509780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.582323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.584356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f676f1-2858-4964-b381-1bcaa81f7ed0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.600115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:04.623091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.623759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.624106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.624387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.625267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:04.625644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.628293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.631361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cfecb-791c-4dd5-b5b8-034f5f0caa29 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.635507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 363/716] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:04.636201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.687077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.688132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.688604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.689070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.695896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:04.696545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.698172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.712980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 354/717] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:04.794124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd27f-4c76-4901-aa34-65e603b61d1a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:04.833768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:04.834872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:04.835348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:04.836352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:04.837274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] RBAC: Adding query filter params (name=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:04.837774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:04.839485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f297299-8fa3-4422-8302-ba7424e8ab79 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:04.845439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 364/718] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:04.856113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:04.973508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9aacd-4a41-4a4d-ab57-8c81d4cda70f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:05.018321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:05.025028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:05.025728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:05.026092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:05.026405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:05.027171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:05.027488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:05.028945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d15cf-44b1-4327-83bf-4074aa6be716 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:05.034450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 355/719] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:05.722796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6592f-0e50-43d7-81a8-ea01d310d361 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:05.723326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6592f-0e50-43d7-81a8-ea01d310d361 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:05.723628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6592f-0e50-43d7-81a8-ea01d310d361 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:05.725373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 365/720] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:05.731401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:05.731852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:05.732000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:05.754899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:05.756113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:05.846303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 356/721] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:05.863865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6592f-0e50-43d7-81a8-ea01d310d361 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:05.912755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:05.973725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6592f-0e50-43d7-81a8-ea01d310d361 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.008965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.010142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.010662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.011139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.022118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:06.030888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:06.031825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:06.032706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:06.039973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 366/722] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:06.041584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.150503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f295a7-5074-4c3c-b407-7c493ba80e17 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.177846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.187554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.188482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.190626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.190626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.190626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:06.190626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:06.192259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48051a0-ad11-4683-9dc1-64d4da299456 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:06.206311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 357/723] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:06.208051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.220165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd431a-dfd1-434b-9019-920a97f057f9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.222842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd431a-dfd1-434b-9019-920a97f057f9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.223355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd431a-dfd1-434b-9019-920a97f057f9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.227106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 358/724] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:06.231876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.231876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.232049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.259738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:06.261480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:06.330596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.333025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0c978-f88e-4153-8059-63f5fc0b8027 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.372814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.373766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.374154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.374555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.386891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:06.388769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:06.407619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:06.408821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:06.409924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:06.409924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:06.409924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:06.409924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:06.415892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 367/725] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:06.417482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.443856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 359/726] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:06.487366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.521341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db3ae-a9ad-416a-a2d2-17f73ff11613 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.558053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.558892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.559247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.559601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.560403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:06.561128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:06.562343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:06.586382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 368/727] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:06.586382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.601937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.661183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb46a8-9ad2-4d72-a041-7d730d2b4568 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.680126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.698645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.699468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.699756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.700036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.711742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:06.719788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:06.720711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:06.721947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 360/728] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:06.726890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.744810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649a8b2-219f-4cd5-a1f9-7888d09e2490 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.811188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.812441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.812922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.813483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.831598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:06.831812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0d1e3-5f06-4ccc-86aa-70febc7d90d8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:06.833125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:06.868328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:06.869353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:06.870724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 369/729] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:06.875655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.884119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:06.884807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:06.885089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:06.885368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:06.886126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:06.886463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:06.887844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:06.901716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 361/730] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:06.907067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:06.962605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.963189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:06.993613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae1cf-609b-48e7-9927-b3f04b06d6ca None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.047068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.047673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.047959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.048249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.049089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:07.049405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.050876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.053341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc4bf-c2d0-45a8-94be-3981fd2c3521 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.088672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 370/731] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:07.095323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.113764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.114595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.114881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.115160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.131464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.133133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6e0f2a88-c6a4-43a5-b170-e0535d90c213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:07.154572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:07.155516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:07.156423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:07.156423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:07.156423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:07.156423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:07.156423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 362/732] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:07.158045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ed06-5000-4430-a2c4-07d3aa2eab3e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.158364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ed06-5000-4430-a2c4-07d3aa2eab3e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.158652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ed06-5000-4430-a2c4-07d3aa2eab3e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.162282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 363/733] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:07.163334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ed06-5000-4430-a2c4-07d3aa2eab3e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.246269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b07a-538e-4345-9191-7c43b80f9a75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.279614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.285376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.285959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.286582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.286872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.287245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.298482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ed06-5000-4430-a2c4-07d3aa2eab3e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.342065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.343086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.343549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.344002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.345415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:07.346062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.348865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a205ce8-15ef-4cc2-aac1-5ad86d9c02ca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.364911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.365152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 364/734] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:07.366739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.366857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.367259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.367674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.388696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:07.390147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:07.482494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 371/735] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:11:07.483592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.488123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 365/736] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:07.488983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.532579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.584920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.603332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bf598-e75a-402b-8d4e-026f0620949f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.609015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4af7b8-8d49-4f38-8142-360e7c2137fd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.649085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.649906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.650237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.650527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.652179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.653056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.653351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.653642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.661253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.661906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.662770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.663816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-39e7720c-58d7-4f92-8345-32d733d05e35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:07.678017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:07.679271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:07.680243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 372/737] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:07.680865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd62-6f08-4e23-9549-51cdfb00e41b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.680865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd62-6f08-4e23-9549-51cdfb00e41b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.681090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd62-6f08-4e23-9549-51cdfb00e41b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.686424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 373/738] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:07.687205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fd62-6f08-4e23-9549-51cdfb00e41b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:07.687585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:07.688652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:07.689594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:07.689594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:07.689594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:07.689594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:07.689594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 366/739] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:07.689973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.792334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.797720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006fb4a-8dd2-426c-bffd-53b7d82fe0f1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.802659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fd62-6f08-4e23-9549-51cdfb00e41b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:07.832772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.833453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.833738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.834018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.834894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:07.835275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:07.836676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5984-2cdb-4f60-b0da-a0bb5ab179d4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:07.836776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:07.837488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.837774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.838060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.838629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:07.849418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:07.854464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 367/740] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:07.855790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda62e-11df-47cf-bcfb-abe2b6659f01 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.856089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda62e-11df-47cf-bcfb-abe2b6659f01 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.856368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda62e-11df-47cf-bcfb-abe2b6659f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:07.857069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:07.857985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:07.858888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 374/741] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:07.859590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.876756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6deda62e-11df-47cf-bcfb-abe2b6659f01 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:07.877974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6deda62e-11df-47cf-bcfb-abe2b6659f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:07.950377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 368/742] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:07.958417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21b89-9874-43e3-92e9-8c5f4957cbbc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:07.958417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21b89-9874-43e3-92e9-8c5f4957cbbc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:07.958417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21b89-9874-43e3-92e9-8c5f4957cbbc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:07.958417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 369/743] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:07.958417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21b89-9874-43e3-92e9-8c5f4957cbbc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:07.968623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94ff4-eeb5-4fd4-ab1b-baf041d4d878 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.003016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.003683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.004076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.004250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.004970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:08.005281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.006690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.019000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 375/744] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:08.019626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.032771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.063842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21b89-9874-43e3-92e9-8c5f4957cbbc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.091992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.096910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.097559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.097848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.098128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.121247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f987b-1592-4d70-b3a8-e30dd82ce347 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.223384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.224066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.224353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.224630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.224971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.225383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:08.225696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.226978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.227588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5491ee-3688-4419-bc0e-177994496cec None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.235955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 376/745] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:08.237182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.237932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.237932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.254389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:08.255583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:08.321110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 377/746] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:11:08.321729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.323956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.336437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 370/747] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:11:08.336437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.359063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.424855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b054a-e6c4-4081-9e4c-4b8e124e9195 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.434058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f261-8340-416b-9fb5-60f760e86918 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.461697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.462389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.462671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.462946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.463668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.465041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.467667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.468516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.468751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.469024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.475669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.477609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:08.491217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:08.492815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 371/748] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:08.493842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.570624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 378/749] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:08 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:08.571465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.582929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.598291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65adf0a-9ef5-461f-836c-1509d49434c2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.649914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.650706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.650999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.651222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.651358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.663408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.665478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:08.683870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:08.684886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:08.685777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:08.685777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:08.685777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:08.685777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:08.685777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 372/750] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:08.686095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.701822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579077e-a405-45ea-90c7-1982bea29650 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.741944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.743814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.744144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.744470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.756824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.758580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:08.780799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:08.781746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:08.782690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:08.782690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:08.782690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:08.782690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:08.782690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 379/751] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:08.783500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.803919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31ee9-e061-460e-a599-d8d5b040009a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.834475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.842146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.842861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.843152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.843439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.844169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.845557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.892271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3b5e-2c15-4419-b615-fae42619f739 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:08.907572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:08.934219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 373/752] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:08 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:08.934219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:08.950776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:08.951464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:08.951748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:08.952022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:08.952946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:08.953281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:08.954788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:08.973991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 380/753] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:08.975065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.071113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b577b9-dad6-4287-a37e-7e1ad2ac351f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.102473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6e8-6633-421a-85f1-d92a87679f83 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.116952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.117904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.118366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.118810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.119790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.120583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.122263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.136905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 374/754] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:09.138071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.145595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.146568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.147002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.148850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.149775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.150354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.151906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.167876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 381/755] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:09.168919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.201990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:09.213541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:09.265364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a3d2-b026-4a95-a1c3-ca3694410b4a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.289415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da5ed-0039-4f0d-9f85-00bebb59b0e6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.305490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.306717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.307225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.307807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.309003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=ab9bf3dd7ae04319987bd7a26c94ed20) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.309554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.311261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.318228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 375/756] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/role_assignments?user.id=ab9bf3dd7ae04319987bd7a26c94ed20&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:09.319374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.327858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.328676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.328960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.329234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.337678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.339680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:09.357456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:09.358594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:09.359555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 382/757] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:09.371559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.440056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0b2b3-c61e-482f-9565-ac8b4aba6527 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.463740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:09.478945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.480151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.480642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.481142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.489437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.492073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:09.508960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:09.509938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:09.510876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:09.513644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 376/758] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:09.519768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.538008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:09.549364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72317c13-8c45-41c6-9811-564c409cf283 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.641217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d58a-ab11-4502-b6d9-5eabeb7244fd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.647162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.647871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.648160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.648439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.649280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.649595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.651144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.671959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 383/759] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:09.679833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.685165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.685165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.685739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.686324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.687824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.688421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.690756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.705844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 377/760] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:09.711629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:09.749269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:09.822978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0533f-b36a-4a7d-8179-9fed8484bce3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.880905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.881601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.884288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793e99-1fc8-4a21-b2b0-7dde9dc513be None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:09.885889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.887393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.892408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=18c8feb5103b47c2a185f2aa32bb37f9) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:09.895781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:09.895781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:09.915637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 378/761] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/role_assignments?user.id=18c8feb5103b47c2a185f2aa32bb37f9&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:09.966786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:09.967598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:09.967888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:09.968174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:09.999229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:10.000719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:10.017747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:10.027416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:10.038907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:10.039967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:10.039967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:10.039967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:10.039967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:10.039967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 384/762] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:10.040263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:10.150039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:10.153228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32dec0-5ec6-4f8f-a7bf-19f31c75dbb2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:10.189475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:10.190290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:10.190502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:10.190759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:10.191494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:10.191812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:10.193210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:10.207116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 379/763] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:10.213176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:10.381408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf30-1fa5-4151-89e4-9da216d923f6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:10.425767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:10.426598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:10.426889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:10.427168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:10.434386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:10.435856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:10.450547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:10.451483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:10.452404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 385/764] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:10.458008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:10.613619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d36e6-445b-40f2-9dfc-948d38a46ba2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:10.666553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:10.667592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:10.668100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:10.668572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:10.669561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:10.670066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:10.671720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed7ac5-31cb-4f55-a181-5ffdeca86ba8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:10.689637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 380/765] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:10.695612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:10.773795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:10.822841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd39b-bbf5-46c8-aca7-d6e30bd99ab7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:10.869013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:10.870531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:10.871127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:10.871608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:10.873986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=b0991f43889c4092baff1a5a1099d673, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:10.875696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee170f-f972-49f8-8bda-c92b0514f8a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:10.942554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 386/766] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:10 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:11:11.170047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edddb-a885-4587-9b74-611f3aae3b92 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.171132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edddb-a885-4587-9b74-611f3aae3b92 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.171650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edddb-a885-4587-9b74-611f3aae3b92 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.173714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 381/767] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:11.180589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3ca90-0d0d-4576-9f1a-146496c7f1e4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.181579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3ca90-0d0d-4576-9f1a-146496c7f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.182068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3ca90-0d0d-4576-9f1a-146496c7f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.200302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-faf3ca90-0d0d-4576-9f1a-146496c7f1e4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:11.201878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-faf3ca90-0d0d-4576-9f1a-146496c7f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:11.283631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 387/768] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:11.308194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edddb-a885-4587-9b74-611f3aae3b92 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.328332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:11.366281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed6e-a843-4657-97fc-b8e7bd712265 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.367173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed6e-a843-4657-97fc-b8e7bd712265 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.367416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed6e-a843-4657-97fc-b8e7bd712265 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.369026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 388/769] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:11.374356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.374646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.374927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.392080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:11.393303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:11.420167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edddb-a885-4587-9b74-611f3aae3b92 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:11.445546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:11.456458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:11.457281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.460393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.460393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.460393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:11.460393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:11.467794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 389/770] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:11.473463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:11.474416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.475428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 382/771] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:11.481232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.506481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.627799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f24e65-7dfa-4bbb-ad2e-f797db0ec0d9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:11.667721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:11.700415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f6c0-83ff-4960-b301-55e58de25f4c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:11.706952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:11.707641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.707934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.708218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.708952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:11.709267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:11.711882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:11.718458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 390/772] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:11.731568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.748762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:11.749720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.750095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.750498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.751251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:11.752837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:11.765737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:11.767015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:11.768093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:11.775350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 383/773] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services/network => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:11.776693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.818963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:11.888260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57bb95-3542-420a-a2a6-5b16a4e190d5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:11.925773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:11.926834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:11.927327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:11.927800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:11.928790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:11.929419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:11.931024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:11.936766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 384/774] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:11.942415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:11.956641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:11.964345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc11-d8eb-4864-8451-bf3400c1b616 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.017776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.018840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.019821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.020343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.021252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:12.021824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.024259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.032198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 391/775] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:12.038328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.160614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c13af-dedf-4ab8-9f96-449d98e8a080 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.171882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:12.200420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed1834-7220-4480-a8e8-d7c66d31dfa7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.202287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.204130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.204639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.205113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.206100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] RBAC: Adding query filter params (interface=public, service_id=57ae5e62dde745f780a75a6872e5681e, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:12.206822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.209366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.218900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 392/776] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/endpoints?service_id=57ae5e62dde745f780a75a6872e5681e&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:12.224459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.280343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.281023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.281307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.281587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.282319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:12.283890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.286398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505dc30-7fc7-454c-b6b1-4314f7e7b850 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.300572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 385/777] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:12.311728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa07b8-50f5-45dc-817a-2b29ced7e191 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.312048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa07b8-50f5-45dc-817a-2b29ced7e191 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.312284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa07b8-50f5-45dc-817a-2b29ced7e191 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.314577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 386/778] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:12.315471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa07b8-50f5-45dc-817a-2b29ced7e191 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.378932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8d5d5-0057-4cc2-89fd-60799d25ec1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.414715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:12.416261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.416939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.417230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.417631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.418361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.419813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1f97-5cf5-4881-89c2-9f9c3aaa5c7a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.425765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 393/779] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:12.428618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84672-405a-4857-ae26-6e75197739a5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.428618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84672-405a-4857-ae26-6e75197739a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.428618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84672-405a-4857-ae26-6e75197739a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.448620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2ff84672-405a-4857-ae26-6e75197739a5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:12.449924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2ff84672-405a-4857-ae26-6e75197739a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:12.457125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa07b8-50f5-45dc-817a-2b29ced7e191 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.516070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:12.527628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.528309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.528596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.528878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.530097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] RBAC: Adding query filter params (interface=public, service_id=09d8303e5a794d149aaf5dd1700fbbd7, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:12.530097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.531556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1dd8-0bd1-4c94-837b-ed607dd77ca6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.541268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 387/780] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/endpoints?service_id=09d8303e5a794d149aaf5dd1700fbbd7&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:12.542826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901abfa-f7fb-4037-bf69-130bf4953b8b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.543116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901abfa-f7fb-4037-bf69-130bf4953b8b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.543395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901abfa-f7fb-4037-bf69-130bf4953b8b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.546320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 388/781] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:12.547357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901abfa-f7fb-4037-bf69-130bf4953b8b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.566251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 394/782] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:12.568384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.568676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.568951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.590651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:12.591871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:12.668881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901abfa-f7fb-4037-bf69-130bf4953b8b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.682126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 395/783] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:12.683336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.720553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.721145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.721440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.721717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.722441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:12.723821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:12.729381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 389/784] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:12.730227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.732878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:12.839098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:12.845446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a599d5-1b17-4370-b521-4ea52b0ce947 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.877075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583e51-065b-4e37-b4d2-0157b2e164e4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:12.924474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.925290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.925572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.925844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.933389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:12.934253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:12.934549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:12.935075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:12.938104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:12.948337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:12.949353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:12.950190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 390/785] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:12.955698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:12.963099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:12.973453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:12.974885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:12.975788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:12.979163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 396/786] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:12.985327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.042784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.087317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e751-f7c9-4f36-98f7-ce79eca865f3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.104964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255c7a-05f9-413b-9ae4-a592e76c521a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.128193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.129268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.129844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.130329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.131317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:13.131797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.134108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.142177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.142917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.143264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.143627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.144443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:13.144816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.146722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.147660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 391/787] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:13.155334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.160798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 397/788] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:13.161975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.182916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.270630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2ee-d95d-49c3-818f-64c35272411d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.314137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.314506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.314729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.315008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.326454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.327996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:13.346026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:13.347005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:13.347909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:13.347909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:13.347909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:13.347909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:13.347909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 398/789] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:13.358730 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.375030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee45d-63f2-4030-87e9-99b215806ad3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.406232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.428333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.430084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.430600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.431103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.456201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.457673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.482610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:13.506897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:13.507928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:13.508853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:13.508853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:13.508853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:13.508853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:13.508853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 392/790] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:13.509133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0325-26ba-4f17-ae44-df9113d39af4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.509207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.536475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.537161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.537431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.537712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.539036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:13.539400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.540830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.554630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 399/791] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:13.560949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.704039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea09f-7cd0-454a-9d6c-bd55c53be9f4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.734001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06fa15-b307-4b16-9e23-f2e4b05769bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.740480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.741967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.742469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.742933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.743895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:13.744413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.746285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e80ab-5e7b-4a4f-9b8c-20a053f8f389 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.759438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 393/792] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:13.761352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247811-1cf0-41e7-976a-d912b38e8471 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.761874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247811-1cf0-41e7-976a-d912b38e8471 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.762385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247811-1cf0-41e7-976a-d912b38e8471 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.764379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 394/793] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:13.765293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da247811-1cf0-41e7-976a-d912b38e8471 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.771100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.778528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.779366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.779656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.780043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.790385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.791978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.809005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b02e8658-7a69-45e6-b57f-2b009a1b8b99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:13.809746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:13.810909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:13.812116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:13.814504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 400/794] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:13.815965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.816410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.816832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.836441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:13.838035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:13.887599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da247811-1cf0-41e7-976a-d912b38e8471 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:13.921115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 401/795] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:13.922578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:13.924318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:13.925254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:13.925608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:13.926110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:13.935801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:13.935801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:13.953289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:13.954951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:13.956015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 395/796] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:13.957900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.066170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb4bee-0d53-467e-81e0-53cd97aba6f6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.085970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.088341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.094003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb1e8-f2b4-4e9f-af9a-dcd47cf21cf0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.104160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.104835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.105166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.105400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.106643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:14.106643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.108048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.135054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 402/797] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:14.135054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.141495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.142695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.143202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.143690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.144782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:14.145360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.147106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.168326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 396/798] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:14.169413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.263974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f7c0-0fff-458a-87b8-eb43e9323f5e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.286353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea77b-cf0a-4359-acc4-33af683e2433 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.300809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.301676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.301967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.302289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.313789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:14.322303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:14.323264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:14.324101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:14.328521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 403/799] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:14.328766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.329369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.330174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.330688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.331155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.342920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.344654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:14.363029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:14.363947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:14.364840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:14.364840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:14.364840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.364840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:14.367090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 397/800] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:14.368071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.377619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.378227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.444875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9e2e-1120-4d70-9b96-1b4a5a9c40d1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.478486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e0-78bf-465a-abfa-a26a72c63e0e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.519580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.520687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.521172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.521648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.522811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:14.523381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.525016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.535415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 398/801] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:14.536617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.603480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.604258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.604780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.604888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.609519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.616688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.618228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:14.638277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:14.639233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:14.640124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:14.640124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:14.640124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.640124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:14.640124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 404/802] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:14.640828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.652095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb1c68-e707-43ff-b234-966f80fa0e98 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.687816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.688841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.689327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.689804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.690801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:14.691317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.692899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.706564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 399/803] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:14.707748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.745375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.755824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af7667-1ab8-4f2d-bd90-6dfe1dee74e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.791629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.792430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.792721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.793001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.806374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.808554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.812549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f58c-f64b-47ec-b879-401f1e8e8625 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:14.832335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:14.833280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:14.834770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:14.834770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:14.834770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:14.834770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:14.835293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 405/804] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:14.836134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.844516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:14.853344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.860689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b1f8-b885-4c31-a0cd-ddb97bcaf093 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 400/805] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b59ed0-d622-4c20-a318-96985e901581 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b59ed0-d622-4c20-a318-96985e901581 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b59ed0-d622-4c20-a318-96985e901581 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 401/806] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:14.873637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b59ed0-d622-4c20-a318-96985e901581 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:14.950301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3aa9b-9d0a-4b0c-b192-57fb30c5e532 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.984584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b59ed0-d622-4c20-a318-96985e901581 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:14.985782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:14.986449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:14.986741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:14.987027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:14.994748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:14.996466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:15.011004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:15.011946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:15.012875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 406/807] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:15.013361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.019884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.028448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.029121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.029409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.029698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.030449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:15.030769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.032223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac54319-9f97-4cc7-9793-4d1278c0bbbc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.045349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 402/808] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:15.050928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.051229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.051516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.069589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:15.070762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:15.115974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.128768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1a1d-74b8-4584-bc15-514c9d8baf9b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.138682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 403/809] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:15.139525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.169852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.170954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.171235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.171511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.178121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.180148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:15.193977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:15.195258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 407/810] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:15.196542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.242867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb473e-db3e-4cc6-bda1-11c54d0af2a9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.264235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.276999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.278137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.278137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.278340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.279013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:15.279329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.280768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54182d-ed59-48a2-a605-e36bb73ce08e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.293422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 404/811] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:15.294710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e544cf-ea87-4727-aee0-ab7ce0ed709a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.295005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e544cf-ea87-4727-aee0-ab7ce0ed709a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.295288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e544cf-ea87-4727-aee0-ab7ce0ed709a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.296531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 405/812] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:15.297234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e544cf-ea87-4727-aee0-ab7ce0ed709a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.309120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829159f7-a8f0-43b5-9c10-c32cff9c751f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.338447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.343461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.344246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.344527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.344802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.352687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.354175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:15.368684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:15.369689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 408/813] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:15.370934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.401791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e544cf-ea87-4727-aee0-ab7ce0ed709a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.435102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.435919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.436206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.436485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.437137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.438541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:15.450644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:15.451800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.452660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 406/814] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:15.454435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.477168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c384-ba10-4a70-a753-f7d7301a23bb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.499794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.510850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.512679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.512679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.512679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.512928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:15.513143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.514594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc036e-ee3a-49e6-b7e6-60b0e3b67efd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.526343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 409/815] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:15.527587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.527851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.528124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.544517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:15.545700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:15.555514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6274-ac0e-4741-8a85-0143d2b2e6a3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.557439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.590828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.591724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.592013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.592292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/ab9bf3dd7ae04319987bd7a26c94ed20/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.594312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=ab9bf3dd7ae04319987bd7a26c94ed20, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.595754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.613256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 410/816] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:15.615320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.656645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 407/817] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:15 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/ab9bf3dd7ae04319987bd7a26c94ed20/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:11:15.657438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.724781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9763fda-5bb0-440a-92b6-591027053e27 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.740117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.766015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.766737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.767024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.767846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.768853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:15.769166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.770646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.782551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6c0cb-5dc0-479d-b725-b6ba2836fd16 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.796487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 411/818] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:15.797391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.825604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.826639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.827078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.827509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.828373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:15.828693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.830100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.834743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 408/819] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:15.836111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:15.886785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:15.902529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d4e1-644a-436a-8706-9d0820043776 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.940732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.941784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.942394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.942808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/18c8feb5103b47c2a185f2aa32bb37f9/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.945375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d68d2-b4e3-4fd9-9e75-dbb6b0674547 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:15.962760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=18c8feb5103b47c2a185f2aa32bb37f9, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.964662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.980988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:15.981833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:15.982121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:15.982431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:15.983090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:15.984473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:15.997176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:15.998339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:15.999182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 409/820] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:16.000415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.038797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 412/821] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:15 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/18c8feb5103b47c2a185f2aa32bb37f9/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:11:16.039632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.073726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.112685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.126115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6982-ca87-455f-9045-ea3f27d34b6e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.167696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.168737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.169233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.169720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.182131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d9b2-c680-4902-9d22-b12c70ffa6e5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.231929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.234816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.234816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.234816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.235311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:16.235765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.237718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.246097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 413/822] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Jul 4 09:11:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:16.247109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.261821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.263341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.360000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.377386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee23ce-0da9-48e4-9cd1-d3ba8d0a95d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.385551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.400005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 410/823] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:16.401351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.417907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.418740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.419092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.419437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.420322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:16.420704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.422290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.428084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 414/824] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:16.429786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.535488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4795-ad9d-4eae-83bb-af27805ee8fc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.542697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453e10-2d48-48c8-a8b6-b2ed2697b3e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.580453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.581115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.581408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.581684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.582008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.582448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.583062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.583447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.583832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.583946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.595510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.597310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.608015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:16.618210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:16.619068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:16.620002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:16.620002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:16.620002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:16.620002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:16.620002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 415/825] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:16.626239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.724760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 411/826] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:16.725993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.752533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384779b-0b30-4347-a07c-1926ba9d0fd0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.840161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.849364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.850470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.856854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.856854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.856854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:16.856854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.856854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:16.865496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 416/827] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:16.869553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:16.939701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf27c1-bfe3-4f12-adee-474b9400fe96 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:16.962423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:16.979973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:16.981046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:16.981561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:16.982623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:16.983690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:16.984217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:16.986360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:17.004446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 412/828] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:17.011656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:17.027705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca055-66d8-4fc9-862e-a058804845e4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:17.082874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:17.083954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.084446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.085041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.085997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:17.087722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:17.143178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa8-83b1-417b-89e8-45c74e1bfc1d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:17.190645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:17.192469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 417/829] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:17.207727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:17.210370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.212507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.212507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.220899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:17.222682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:17.240042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:17.241065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:17.243009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 413/830] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:17.247794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:17.412826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fe29-ca49-4a66-8583-93f66537900b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:17.431441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:17.451641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:17.452704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.452823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.453057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.453845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:17.454154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:17.455617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442adfcf-80fb-471f-bec3-85bef8fb8607 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:17.470743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 418/831] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:17.477134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:17.613461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae0bcb-f23a-430c-8046-33d93f36fd95 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:17.661205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:17.661874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.662161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.662474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.663931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:17.664193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:17.665635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f041fcd-f127-4d3d-afe2-212586868022 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:17.672853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 414/832] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:17 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:17.965819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f27f7-69e6-4604-8ab6-95d0535811df None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.966159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f27f7-69e6-4604-8ab6-95d0535811df None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.966414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f27f7-69e6-4604-8ab6-95d0535811df None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.968029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 419/833] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:17.973307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d301cd-880d-4c33-856f-aad2b2873289 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:17.973599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d301cd-880d-4c33-856f-aad2b2873289 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:17.973879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d301cd-880d-4c33-856f-aad2b2873289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:17.991764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a8d301cd-880d-4c33-856f-aad2b2873289 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:17.992953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a8d301cd-880d-4c33-856f-aad2b2873289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:18.015590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.186690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 415/834] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:18.210355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f27f7-69e6-4604-8ab6-95d0535811df None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.251859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d54fb-1033-4d9a-9f60-a870e725fef6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.252306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d54fb-1033-4d9a-9f60-a870e725fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.252695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d54fb-1033-4d9a-9f60-a870e725fef6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.255614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 416/835] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:18.261487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.261886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.262306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.283315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:18.284888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:18.325378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f27f7-69e6-4604-8ab6-95d0535811df None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.370679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.371910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.372296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.372671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.374298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 417/836] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:18.384778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:18.392573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:18.393495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:18.394378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:18.395014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.395094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 420/837] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:18.399855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.441656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.497317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.514497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802dfa8-1fee-4897-a4ce-7acd204ff54b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.527832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cd40f-8a65-4ced-a54e-782ab1abb5b9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.551558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.552762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.553189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.554179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.565870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:18.568174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.568845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.569749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.570029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.570811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:18.571126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:18.572496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:18.576214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:18.577333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:11:18.578320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:18.580573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 418/838] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:18.586261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 421/839] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:18.587289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.592670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.707469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7150-271f-44f3-a5b5-3a736e3a694f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.719679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.724335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330ad86-d6a0-4696-8194-c53078ab1135 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.747172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.748160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.748612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.749031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.749977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:18.750481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:18.752376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:18.763421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 419/840] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:18.768930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.773565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.774725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.775145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.775583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.783022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:18.791372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:18.791372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:18.808888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:18.810012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:18.811160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:18.811160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:18.811160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:18.811160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:18.814516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 422/841] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:18.815940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.894027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387916-6f32-4d5f-a92c-88e9ec0713a7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.927523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfd57-1b0d-40e4-b026-19bdf5b6150e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:18.938494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.939397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.940006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.940289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.954377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:18.956317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:18.964327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:18.965122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:18.965508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:18.965887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:18.966804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:18.967238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:18.968750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:18.976613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:18.977732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:18.978878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:18.978878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:18.978878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:18.978878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:18.982286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 420/842] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:18.984419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:18.990319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 423/843] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:18.992253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.010627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.059075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.104889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cbb6-45ba-487c-9c22-fded9357a934 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.109958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb050c-b69a-4bf9-8cb4-642824469f35 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.141881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.142811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.143167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.143454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.150802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.151470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.151925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.152115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.152212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.152831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:19.153146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.153578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.154545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1409898-85fa-4245-bd24-8f76bc339e34 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.176644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 421/844] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:19.176857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:19.177949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:11:19.179165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:19.179817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d9a4-00f8-45b9-9085-d8cf91f326b5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.179908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 424/845] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:19.179990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d9a4-00f8-45b9-9085-d8cf91f326b5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.179990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d9a4-00f8-45b9-9085-d8cf91f326b5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.179990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 422/846] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:19.180201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.180301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.180301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.180301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.197653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:19.198886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:19.265918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.279039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 423/847] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:19.279985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.306871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268846-2f8d-43a7-a969-c913fe121f2f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.336782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.344837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.345646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.346043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.346395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.356134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.357904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:19.377300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:19.378324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:19.379294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 425/848] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:19.380531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.393934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed580a-d37d-4c11-b86d-7cc125c6c478 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.439083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.439758 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.440043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.440318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.441159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:19.441462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.442937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.467031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 424/849] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:19.467031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.494287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c3-43c8-493f-88d1-73a7961da0f3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.525811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.531838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.532640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.532929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.538332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.538332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.538332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:19.547318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:19.548546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:19.549396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 426/850] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:19.550404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.576120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae2c0a-48e5-4f0d-bd1d-ffb38dc7ead8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.587600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.612811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.613771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.614261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.614705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.615695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:19.616206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.617639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.638495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 425/851] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:19.639220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.668264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f426a-59df-4f4b-9b0c-d01a04383812 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.706719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.707433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.707720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.708161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.750049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473e94-46b4-4f53-8af8-b29f8ecea8e0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.775703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.783554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.784952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f25c-07a5-4227-ab08-177b4c9a3eb9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.787982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.788654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.790632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.790632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.790632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:19.790632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:19.791692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:19.796850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 426/852] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:19.797752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.828698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.884480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 427/853] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:19.886183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba475-fe8d-4704-aede-2b73c37514fd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.886489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba475-fe8d-4704-aede-2b73c37514fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.886769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba475-fe8d-4704-aede-2b73c37514fd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.888027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 428/854] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:19.888716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ba475-fe8d-4704-aede-2b73c37514fd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:19.902018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a69f9-da74-42ed-a634-f36a9f9537f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:19.936739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:19.937388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:19.937672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:19.937952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:19.981973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:19.989480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ba475-fe8d-4704-aede-2b73c37514fd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.004845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.006347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdfdde-2f28-49f5-82b5-cebba328f8d4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.023641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.024305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.024593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.024876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.025580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:20.025975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.027375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.032125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 429/855] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:20.033023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.043838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.128414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 427/856] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:20.130435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.130942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.131470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.149268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:20.150948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:20.153609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b81-97de-47a0-b897-ab89e4a465de None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.201151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.201953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.202269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.202649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.213921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.215493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.237440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 428/857] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:20.237440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:20.238301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:20.239315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:20.240193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:20.240193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:20.240193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:20.240193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:20.242854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 430/858] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:20.244041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.256802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.307107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.347213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848feb-076d-47b0-b80b-59bc82fd236c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.355011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384fdd6-732e-4d73-b636-7cbd6191269a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.385445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.386272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.386566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.386851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.398179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.398963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.399301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.399726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.400177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.400418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.401218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:20.401669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.403446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.416733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 431/859] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:20.417756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:20.418671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:20.419535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:20.420419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:20.420419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:20.420419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:20.420419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:20.426532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 429/860] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:20.427565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.499763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.532364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4fde4-1521-46da-a780-c04f5246bd41 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.536649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1091c8d-31fb-47e3-9a8e-5ad78c825f57 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.550696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.569196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.569893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.570184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.570526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.571240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.572564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.573187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.574053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.574377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.574689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.581818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.583858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:20.585819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:20.586855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:20.587793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 432/861] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:20.588669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:20.605253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:20.606187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:20.607251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 430/862] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:20.608935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.700715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7ee7a-b715-4e38-ab3d-41abbd1a73d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.715504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344898-1caa-4611-bc23-d646b7832168 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.736665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.737337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.737627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.737907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.738674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:20.738990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.740361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.741868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.752434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.753186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.756911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.756911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.757201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 433/863] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:20.757277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:20.757347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.757571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.757571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.762634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 431/864] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:20.763458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.805376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:20.865010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d61f-b7cd-4f63-9e25-bceebadc8dcc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.872047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0472d-2df0-407c-81f8-67f4ac7f8bbb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:20.903130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.903789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.904063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.904343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.905125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:20.905438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.906814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:20.906932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.907615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:20.907902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:20.908181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:20.915233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:20.916707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:20.923828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 434/865] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:20.923828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:20.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:20.938372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:20.939472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:20.943006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 432/866] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:20.944373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:20.986723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:21.036891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a321bc-2803-4f89-8f5e-381d9dc49847 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:21.047178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:21.052884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b86df-f40d-4f2e-8047-3d1e1f979e57 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:21.073720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:21.074418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.074707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.074991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.075705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:21.076017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:21.077429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:21.082393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 435/867] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:21.083109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:21.102486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:21.103238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.103520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.103803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.104678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=ab9bf3dd7ae04319987bd7a26c94ed20) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:21.105028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:21.106631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:21.113961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 433/868] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:20 2022] GET /identity/v3/role_assignments?user.id=ab9bf3dd7ae04319987bd7a26c94ed20&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:21.216967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9669-ed89-469a-8a9b-65d8f59e8381 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:21.238618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:21.260247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:21.260247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.260527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.260596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.261479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:21.262136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:21.263283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b002-0cb4-4409-a155-3fea2eb6addc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:21.277210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 436/869] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:21.283029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:21.399836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873a99-fc6e-4fa8-8339-daf4f9fdd02f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:21.436628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:21.437585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:21.438050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:21.438522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:21.439566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=18c8feb5103b47c2a185f2aa32bb37f9) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:21.440063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:21.441737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f945-3eaf-4fe8-b27e-b21accb84b3b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:21.449260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 434/870] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:21 2022] GET /identity/v3/role_assignments?user.id=18c8feb5103b47c2a185f2aa32bb37f9&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:22.102619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f10f62-9c87-46a2-ae55-a8a58091929b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.105118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f10f62-9c87-46a2-ae55-a8a58091929b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.105118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f10f62-9c87-46a2-ae55-a8a58091929b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:22.105118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 437/871] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:22.110318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f69de-a30c-4612-b13f-96681d4e8385 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.111143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f69de-a30c-4612-b13f-96681d4e8385 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.111642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f69de-a30c-4612-b13f-96681d4e8385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:22.129177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-084f69de-a30c-4612-b13f-96681d4e8385 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:22.130692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-084f69de-a30c-4612-b13f-96681d4e8385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:22.150036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:22.205369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 435/872] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:22.229484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f10f62-9c87-46a2-ae55-a8a58091929b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:22.343493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f10f62-9c87-46a2-ae55-a8a58091929b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:22.383060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:22.383659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:22.383950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:22.384232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:22.384975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:22.386387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed42815-e0a5-4b64-9772-4169e08afb05 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:22.468571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 438/873] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:22 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:23.242374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6d3ec-4d12-4f42-9e8a-1e451b7f715f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.242890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6d3ec-4d12-4f42-9e8a-1e451b7f715f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.242967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6d3ec-4d12-4f42-9e8a-1e451b7f715f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.244563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 436/874] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:23.249994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.250441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.250613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.269477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:23.270693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:23.302460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:23.317912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1299c0-31ad-4bae-b1a2-8f272c839337 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.318290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1299c0-31ad-4bae-b1a2-8f272c839337 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.318544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1299c0-31ad-4bae-b1a2-8f272c839337 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.321667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 437/875] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:23.325829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.326125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.326447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.346858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:23.348146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:23.349458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 439/876] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:23.377167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.438305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 438/877] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:23.462841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.515360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32db562-54f5-44c2-9c80-ba4b8fe7f354 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:23.552838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:23.560973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:23.562528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.563269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.563733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.565140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:23.567194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602dd5f-79e4-4b1e-9105-ea45a4bc22a9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:23.571109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2234e-2d74-4e1f-ae69-374b731e00fc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:23.617541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218270ab-2413-4356-8d35-344491f955ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:23.618475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218270ab-2413-4356-8d35-344491f955ae None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.618673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218270ab-2413-4356-8d35-344491f955ae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.618950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218270ab-2413-4356-8d35-344491f955ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.619609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218270ab-2413-4356-8d35-344491f955ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:23.621256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218270ab-2413-4356-8d35-344491f955ae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-218270ab-2413-4356-8d35-344491f955ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:23.633966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:23.639285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:23.640398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 439/878] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:23.641703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143b67-7035-43c2-b343-c1c2bc14bc61 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.641703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143b67-7035-43c2-b343-c1c2bc14bc61 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.641703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143b67-7035-43c2-b343-c1c2bc14bc61 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.641703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 440/879] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:23.642581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46143b67-7035-43c2-b343-c1c2bc14bc61 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.674222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 440/880] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:23 2022] POST /identity/v3/services => generated 269 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:23.674222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.674222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.674222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.698809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:23.700868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:23.727457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:23.789442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46143b67-7035-43c2-b343-c1c2bc14bc61 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:23.804628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 441/881] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:23.829477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.839443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:23.840011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:23.840298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:23.840694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:23.841420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:23.841731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:23.843286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:23.848393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 441/882] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:23.854558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:23.869715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:23.970588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d42f6-f689-46b3-89cf-13cdb6478cf5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:23.979755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5117-96ec-49a0-a458-76f05491b9e9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.008924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.009770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.010026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.010341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.020482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.021493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.021675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:24.022242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.022796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.023710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:24.024224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.025973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:24.030386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:24.031343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:24.032207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 442/883] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:24.034244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 442/884] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:24.037947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.059527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:24.161195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5f6e-19ad-4ee4-ac90-b5d2a78d3db6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.201764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.202484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.202774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.203056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.203820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:24.204191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.205576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.216734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 443/885] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:24.222748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.302396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:24.333702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee208d-a6a9-4154-be74-b06a6085a18c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.370269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.371077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.371364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.371644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.383563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.385029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-99b2e792-c9d3-4927-89db-bb2784a05610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:24.403129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:24.404102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:24.405695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:24.405695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:24.405695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:24.405695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:24.405695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 443/886] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:24.410139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.493837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:24.518504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb8cb5-c939-4a64-a0c2-9dcf0aa04102 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.550007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a7c3-dbd4-4418-9799-8b2b54d2d380 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.550386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a7c3-dbd4-4418-9799-8b2b54d2d380 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.550595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a7c3-dbd4-4418-9799-8b2b54d2d380 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.552224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 444/887] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:24.553973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.554670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.554952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.555226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.555959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:24.556267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.557647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.562012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.562586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.563075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.571304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 444/888] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:24.576721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.582385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:24.583583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:24.682435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 445/889] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:24.693373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d174-2728-44d6-bee6-6d2d49bda2ff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.705417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.738326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.740152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.741463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.741952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.746971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:24.752886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.755251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.770765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:24.781327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:24.804891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 445/890] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:24.805952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.824461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f773b24-533c-47e7-b722-8af50e2d9aaf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.864874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.866319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.866596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.866871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.867613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.868921 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:24.881816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:24.883026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:24.883962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:24.884718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 446/891] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:24.892061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:24.928778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d007a-7924-4493-b398-69b4a533f7cc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:24.975382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:24.976104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:24.976392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:24.976667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:24.977510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:24.978013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:24.979594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.006281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 446/892] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:25.009605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.016578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f03c-66c6-4a0a-be07-9771299b58f2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.036463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.055165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.055841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.056225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.056512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.057335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:25.057653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.059168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.069495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 447/893] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:25.070546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.086560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.141076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318a9-9f2e-467a-93f5-35d217286c8b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.179048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.179859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.180300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.180417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.202097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591324-d641-48eb-b46a-2e9fa630209d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.249367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.250636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.251280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.251779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.252736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:25.253280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.255083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.261993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 448/894] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:25.268338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.279165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.281087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.329118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.339391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.391417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595da9-a723-4b31-9498-ee2535525a8d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.407632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 447/895] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:11:25.409112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.435505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.436690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.437188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.437702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.438736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] RBAC: Adding query filter params (interface=public, service_id=bf04a6a2e53c4d3bb86d3428c87456be, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:25.439355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.441086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.448122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 449/896] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/endpoints?service_id=bf04a6a2e53c4d3bb86d3428c87456be&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:25.453641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.526372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496f7d2-0a48-4fc7-a6da-703ceab4da4d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.569244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.569801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.570088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.570391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.579683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee17f2-9f80-49e9-8301-ce3f7393880c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.580992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.582476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.592227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:25.601472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:25.605009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:25.606013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:25.606013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:25.606013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:25.606013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:25.606013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 448/897] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:25.608562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.617809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.626904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.628180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.628676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.629178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.630130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.633127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.640677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 450/898] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:11:25.734117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9cc4e-8a86-436a-8707-1fd6d3091f31 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.778070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.778691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.778980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.779264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.780014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:25.780329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.781744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28e95-7fba-4dc5-a6a7-9e9eaa0cc753 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.795308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 449/899] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:25.801216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:25.863026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333461f1-2483-4093-8a47-65174ef50b34 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.863375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333461f1-2483-4093-8a47-65174ef50b34 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.863611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333461f1-2483-4093-8a47-65174ef50b34 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.864975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 450/900] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:25.871439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.871825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.872187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.899302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:25.901131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:25.928721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ed94-cfc1-493c-99f7-f3deb3429c6b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:25.967872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:25.969026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:25.969646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:25.970143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:25.978581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:25.980354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:25.982278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:25.991022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 451/901] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:25.999120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:26.000052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:26.000948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:26.002378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 451/902] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:26.008315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.014394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.051352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.120252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f827-3ec6-433f-a013-94b024adce03 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.121744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd7ea-4a2a-443e-900d-177ff3fabfb8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.158659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.158883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.159341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.159628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.159911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.160021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.160414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.160713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:26.160866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.161026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.161729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.162537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.163439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.175606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 452/903] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:26.177157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:26.178324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:26.179384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:26.183776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 452/904] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:26.186462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.187493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.257094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.296822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.301525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b453c4-b40f-46ae-b16e-76da7fb7ee62 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.303712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bb501-6e80-45ea-ac75-ac79d4662a1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.339300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.339824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.340055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.340155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.340247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.340338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.340535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.340631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.341199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:26.341365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] RBAC: Adding query filter params (role.id=35a3914f2f714f2b98152f5101679de5, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=18c8feb5103b47c2a185f2aa32bb37f9) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:26.341527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.341675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.342998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae760f-3393-45f9-8e49-2d9949f1620b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.343225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.348594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 453/905] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:26.349677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7200fb-e337-4b62-9d59-a30f75ce813a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.350011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7200fb-e337-4b62-9d59-a30f75ce813a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.350321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7200fb-e337-4b62-9d59-a30f75ce813a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.358505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 453/906] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/role_assignments?user.id=18c8feb5103b47c2a185f2aa32bb37f9&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=35a3914f2f714f2b98152f5101679de5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:26.358505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.358790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 454/907] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:26.358790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.358790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.358790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.379866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:26.381731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:26.469260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 455/908] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:26.493389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa8bb9-86c7-4ad3-b0e9-12fc750326b8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.496623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.522354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.538161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.538161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.538161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.538161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.539065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:26.539147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.540683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.546635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 454/909] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:26.552449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.604140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.613707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88193b-544f-4b0d-8f58-eedcb77b2d91 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.652931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.653882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.654351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.654796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.655688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.657308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fd34-7c6b-4c11-aa80-27dd762bbecd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.685148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbbc-88b6-46a8-9f22-06ba84754a75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.721696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.722393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.722684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.722970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.723760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] RBAC: Adding query filter params (interface=public, service_id=08498c2dbee44908a779a1f3c672e6aa, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:26.724075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.725519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.735162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 455/910] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/endpoints?service_id=08498c2dbee44908a779a1f3c672e6aa&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:26.736191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:26.750499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 456/911] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:26 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:26.801734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:26.864118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d9e04-eefc-44d9-ad7b-5b9bc11a6976 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:26.909970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:26.909970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:26.909970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:26.909970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:26.912838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:26.912838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370751d-77b5-49fa-9380-11d884177259 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:26.919953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 456/912] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:26 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:11:27.808367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb08adc-7462-451a-a10e-9f6544ebd725 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:27.808931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb08adc-7462-451a-a10e-9f6544ebd725 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:27.808931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb08adc-7462-451a-a10e-9f6544ebd725 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:27.810570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 457/913] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:27.816079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:27.816492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:27.816662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:27.833684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:27.834940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:27.910362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 457/914] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:27.928396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb08adc-7462-451a-a10e-9f6544ebd725 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.042055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb08adc-7462-451a-a10e-9f6544ebd725 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.093462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.093462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.093462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.093462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.093935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:28.093935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:28.096710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:28.097679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:28.098566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 458/915] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:28.104668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.144741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:28.206804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880d1ac-a482-44f8-a0d9-91605118d502 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.243056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.243723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.244006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.245233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:28.245540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:28.246929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:28.252033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 458/916] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:28.257635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.283885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:28.367954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630b04d-45be-41c7-9b94-dce9574d26aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.403984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.404985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.405474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.405945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.406863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:28.407372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:28.408939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cf0da-c8a5-40c2-96b6-1e8764305b45 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:28.414689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 459/917] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Jul 4 09:11:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:28.423085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.474731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de256-316a-4741-98aa-c7c676438ea0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.474925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de256-316a-4741-98aa-c7c676438ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.475176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de256-316a-4741-98aa-c7c676438ea0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.476819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 460/918] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:28.482510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.482806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.483209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.503765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:28.504978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:28.530459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97f65c-21fa-44b6-9056-bb3e11271620 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.532292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:28.567447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.568220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.569127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.569475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.570398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:28.571914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:28.591059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 461/919] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:28.613936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.626394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:28.646522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 459/920] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:28.743583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa006856-828a-46d1-9e06-7b4d5914098e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.789781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.790660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.790944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.791219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.808621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e4f5e005-748b-4170-9daa-ecf543bb2fa1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:28.818149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:28.819781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:28.820657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:28.823265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 462/921] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:28.830483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:28.924305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fc47-b754-4ec0-9cf7-5f5de8a4ab6f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.924609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fc47-b754-4ec0-9cf7-5f5de8a4ab6f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.924802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fc47-b754-4ec0-9cf7-5f5de8a4ab6f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.926454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 463/922] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:28.932187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.932486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.932774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:28.947960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6325-0bbb-4f4e-815a-946685a6f54d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:28.950712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:28.951918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:28.996537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:28.998212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:28.998721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:28.999252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.000670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.001216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.003291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.016250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 460/923] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.022276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.023010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.032083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 464/924] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:29.048416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.057376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.144020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9aad-4a05-4d97-bb94-9874df4f8fa8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.171767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ebc0-8f8f-46c2-aae7-3a13aa8d94a9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.182098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.182857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.183146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.183430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.195349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.196935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.215310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e94583af-307b-4a43-8030-2e07f5afa4d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:29.215513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:29.216402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:29.217319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:29.217319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:29.217319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:29.217319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:29.217319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 461/925] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:29.217908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ba4e-2ae5-4176-9b2a-4c8f55f92e5e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.218059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ba4e-2ae5-4176-9b2a-4c8f55f92e5e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.218365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ba4e-2ae5-4176-9b2a-4c8f55f92e5e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.219235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.223525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 462/926] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:29.223525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ba4e-2ae5-4176-9b2a-4c8f55f92e5e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.223748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.223748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.223748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.227904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7b6a6328-d067-4ce2-8015-d3397b231a0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:29.241999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:29.243134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:29.243994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 465/927] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:29.245056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.245056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.246217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.262480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:29.263685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:29.309734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.324399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.335809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 466/928] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:29.336875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.355113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ba4e-2ae5-4176-9b2a-4c8f55f92e5e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.394836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.395508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.395793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.396073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.396835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.397146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.398560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.410845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 463/929] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.416531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.445327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7378c-8cde-4797-9db5-24028211d7ff None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.483547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.484217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.484506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.484788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.485502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.485815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.487241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.498226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 467/930] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.498226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.524066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b83d-007c-442a-80ca-b3f43434f977 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.554644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.559692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.560504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.560789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.561069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.561503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.561725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.563285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:29.575585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:29.576557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:29.577421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 464/931] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:29.578321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.611431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f115-b6db-491c-9326-ac0757d62e6e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.654218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.655342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.655813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.656304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.664815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.666790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:29.683090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:29.684056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:29.685035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:29.685602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9d28-f033-4e38-bed9-3829dd8b6293 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.687271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 468/932] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:29.688208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.721957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.722670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.722953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.723239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.723952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.724267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.726330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.731733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 465/933] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.732524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.798170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.799328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867a32-79be-4d75-92b9-084195bef26b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.817595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:29.838931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.839616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.839903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.840187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.840902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.841220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.842677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.852653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 469/934] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.852653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.858313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512225e1-ec9c-4b84-8190-b6a0062402ad None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:29.898727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:29.899406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:29.899692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:29.899968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:29.900805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:29.901118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:29.902592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:29.920162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 466/935] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:29.920980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:29.967034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4781-cc62-4b3a-b558-4055ff341585 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.004163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.004832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.005123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.005400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.006186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] RBAC: Adding query filter params (interface=public, service_id=64f9b5fd7f8d4ec8b0908ac8cc7193a3, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:30.006525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.007895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.013064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 470/936] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/endpoints?service_id=64f9b5fd7f8d4ec8b0908ac8cc7193a3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:30.014042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.038668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ced-0c11-4e50-a1ca-de79d7001f75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.057699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.066153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.075655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.076331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.076657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.076940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.077653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:30.077965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.079377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.089175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 467/937] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:30.090054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.126524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e0e38-d8cd-46b6-b26b-0886d9f9a91b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.162926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.163848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.164183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.164537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.176043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.178238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:30.195676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:30.196575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:30.197453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:30.197453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:30.197453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:30.197453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:30.197453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 471/938] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:30.197737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.209605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f9ba6-4b99-40b8-8d4c-3e5160b40911 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.253288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.254041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.254483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.254711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.255421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.256795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.263399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 468/939] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:30 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:11:30.264202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.321179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.327115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.338443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9696a-cf84-4be6-ae60-1485e9b8dffe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.382714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17f0c0-cb3f-44dd-b560-c81ece860fe2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.392014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.393111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.394145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.394719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.396219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.398578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.427303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.428002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.428286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.428563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.429287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:30.429649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.431062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.443244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 469/940] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:30.449010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.517615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 472/941] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:30.571142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e7e5-e473-491f-9702-a5d43925affb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.579802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.622762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a8485-808e-4203-9284-fa7712748493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.623572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8485-808e-4203-9284-fa7712748493 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.623857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8485-808e-4203-9284-fa7712748493 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.624134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8485-808e-4203-9284-fa7712748493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.633081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a8485-808e-4203-9284-fa7712748493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.634593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a8485-808e-4203-9284-fa7712748493 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-199a8485-808e-4203-9284-fa7712748493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:30.650748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:30.651731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:30.652617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 470/942] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:30.659378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.774252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466afec-925e-4507-a0a5-0dae9d4db1d2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.823066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:30.824041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.824041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.824456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.825081 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:30.825432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:30.826927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:30.833478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae7ac-95b1-4b55-bf2a-0a0a5ac1b76c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.833905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae7ac-95b1-4b55-bf2a-0a0a5ac1b76c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.834667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae7ac-95b1-4b55-bf2a-0a0a5ac1b76c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.836321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 471/943] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:30.842121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:30.842421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:30.842709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:30.846309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 473/944] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:30.849879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:30.862919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:30.863552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:30.864207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:30.962268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 472/945] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:30.978218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667d59-cb54-4f6d-a1dd-baafade1cf3c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:30.989166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:31.025510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:31.027064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.027561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.028025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/18c8feb5103b47c2a185f2aa32bb37f9/roles/35a3914f2f714f2b98152f5101679de5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.031687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=18c8feb5103b47c2a185f2aa32bb37f9, role_id=35a3914f2f714f2b98152f5101679de5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:31.033384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:31.092033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:31.101318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564130a-7855-4c08-a347-b366ad4d6bbf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:31.121492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 474/946] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:30 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/18c8feb5103b47c2a185f2aa32bb37f9/roles/35a3914f2f714f2b98152f5101679de5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:11:31.147989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:31.148670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.148955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.149228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.149969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:31.151761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:31.153248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING keystone.server.flask.common [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:11:31.204129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.sql.core [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:11:31.204129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:11:31.204129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [parameters: {'id': 'f5f43398f231431294b96214496b47c3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:11:31.204129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80331) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5f43398f231431294b96214496b47c3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5f43398f231431294b96214496b47c3. Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:11:31.222112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application result.read() Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 04 09:11:31.223031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application yield resource Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise self.value Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application session.commit() Jul 04 09:11:31.224027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:11:31.224995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:11:31.225926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application result.read() Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:11:31.231468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [parameters: {'id': 'f5f43398f231431294b96214496b47c3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:31.233608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:31.235562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5f43398f231431294b96214496b47c3. Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:31.243797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 473/947] 10.222.0.61 () {60 vars in 1140 bytes} [Mon Jul 4 09:11:30 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:31.249379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:31.327686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:31.361482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb9660-b996-4bb4-ae76-0bc9588c4aaa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:31.400320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:31.401501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.401993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.402526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.410748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:31.413116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3f70f352-2c79-42be-b050-c063bacbd915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:31.429578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:31.430589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:31.431476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:31.434076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 475/948] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:31.441176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:31.559537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3bd5-635c-4f3c-af30-aaf0bc146dfa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:31.595528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:31.596536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:31.597026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:31.597504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:31.598577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:31.599095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:31.601459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0561b-fe45-4b96-b3be-c6199c180017 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:31.625051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 474/949] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:32.423651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c517-de06-44b8-bf27-20346a245e66 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.424203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c517-de06-44b8-bf27-20346a245e66 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.424203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c517-de06-44b8-bf27-20346a245e66 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.425851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 476/950] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:32.431881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76785-3af0-4131-89c7-05b5b05c204f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.432370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76785-3af0-4131-89c7-05b5b05c204f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.432451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76785-3af0-4131-89c7-05b5b05c204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.449887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a3c76785-3af0-4131-89c7-05b5b05c204f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:32.451453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3c76785-3af0-4131-89c7-05b5b05c204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:32.453506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:32.526578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 475/951] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:32.549639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c517-de06-44b8-bf27-20346a245e66 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:32.654319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c517-de06-44b8-bf27-20346a245e66 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:32.671783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590710-c58f-47d7-a832-ce295a9a2d3e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.672115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590710-c58f-47d7-a832-ce295a9a2d3e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.672343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590710-c58f-47d7-a832-ce295a9a2d3e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.675054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 476/952] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:32.679247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.679537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.679820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.686992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:32.693487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:32.694636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.694920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.695199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.699761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:32.699761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:32.699937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:32.699937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:32.712816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:32.713965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:32.714901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 477/953] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:32.720473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:32.783934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 477/954] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:32.806933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:32.844968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44320a3-ac66-4dc1-81f8-d7a9ac19224a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:32.885011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:32.885950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:32.886277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:32.887018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:32.888023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:32.888342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:32.890468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:32.903395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:32.904119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 478/955] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:32.905519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:32.951033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab7fe-6afa-41ba-9197-d7557bbb138f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:32.984887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:33.000195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.001364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.001884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.002398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.003287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.004870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:33.020082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:33.021186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:33.022592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:33.026247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 478/956] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:33.031851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.038242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697e479-a7ce-4cf4-934e-f603c5daa69c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.085422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.086230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.086641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.086942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.087667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:33.087979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.090091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.098272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 479/957] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:33.102722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.162281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e363d-fc99-4795-bd4f-8df0ec4b5bdb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.201140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:33.211010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54e1b-af1b-4357-af21-fe637ab280de None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.214845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.215552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.215834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.216105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.216819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:33.217123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.218520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.224160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 479/958] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:33.231341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.252587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:33.265709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.266564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.266774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.267036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.267773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.269145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb960b6-623f-40d2-a75d-35470757d2b9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.346185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b40e-7cc8-4256-b35b-ab1e548fc17b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.362180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 480/959] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:33.362180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821dbf-e003-44d4-a3bb-362c7275a41d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.362180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821dbf-e003-44d4-a3bb-362c7275a41d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.362180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821dbf-e003-44d4-a3bb-362c7275a41d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.362180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 481/960] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:33.369313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.369313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.369313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.383505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:33.384841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:33.407166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.407843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.408736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.409021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.409912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:33.410382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.412098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.420143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 480/961] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:33.472176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 482/962] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:33.497870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.568007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:33.619477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5269-41d8-4607-9d85-2b924eaaf838 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.658454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.659277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.659562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.659841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.671506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:33.680517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:33.681530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:33.682497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 481/963] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:33.687842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.792947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bce2c3-3523-4d2b-9f2b-27e1113b76ef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:33.803795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:33.830046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:33.830809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.831143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.831425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.832187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:33.832499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:33.833919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99052-07fe-47d3-afe3-4a2e1e86f150 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:33.848076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 483/964] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:33.849076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:33.872193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f526-65bd-4469-9579-555c86b4587d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.872475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f526-65bd-4469-9579-555c86b4587d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.872670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f526-65bd-4469-9579-555c86b4587d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.877812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 484/965] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:33.879425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:33.879779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:33.880065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:33.899293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:33.900493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:33.986343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 485/966] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:33.991445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43964c7-2d0b-4749-b348-b53b12781dce None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.011906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.018647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.043180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.045017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.045539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.046262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.061499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.065557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:34.086439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:34.089288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:34.090433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:34.090433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:34.090433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:34.090433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:34.090433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 482/967] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:34.093060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.140161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.144400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d371c-2ecf-4d14-a0af-94fa795671da None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.192845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.194475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.194975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.195496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.196444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.199014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.201264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING keystone.server.flask.common [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:11:34.210055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6a43-b8c8-41eb-9a47-0f24b5a1f956 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.254246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.254937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.255222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.256121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.256843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:34.257150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.258625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.267184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.sql.core [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:11:34.267184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:11:34.267184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [parameters: {'user_id': 'c17a028cbd0b4b11b4c9c1c14cb500af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:11:34.267184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:11:34.272432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 483/968] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Jul 04 09:11:34.276952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:11:34.277898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application yield resource Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise self.value Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application session.commit() Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:11:34.279347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:11:34.280298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:11:34.281199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:11:34.282071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c17a028cbd0b4b11b4c9c1c14cb500af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:34.285721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 04 09:11:34.287806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:11:34.290738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.292280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.294023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 486/969] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Jul 4 09:11:34 2022] POST /identity/v3/users => generated 160 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:34.302783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.313649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.403474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfd85b-1989-4656-943a-9e2246146d72 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.426432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832c19-dc65-4d78-a5f0-a08c27315dbc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.443072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.444054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.444404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.444761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.452326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.454004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:34.469348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:34.470548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:11:34.471826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:34.472820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.474874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.475319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.475744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.477385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 484/970] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:34.478256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.486414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.488871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:34.506287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:34.507492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:11:34.508594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:34.512467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 487/971] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:34.513360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.540154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.602264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.621128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c4da4-6f1e-4f78-b78d-32f832f0a611 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.625385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4ccd-42eb-4958-baac-d185c5d6008e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.665754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.666410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.666699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.666984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.667803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:34.668110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.669651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.672381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.673236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.673663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.674081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.675079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:34.675549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.677105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:34.699831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 485/972] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:34.706232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:34.713630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 488/973] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:34.826036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec13f5-f1c1-438c-bbc1-35d54f723253 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:34.865262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:34.866188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:34.866687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:34.867116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:34.893528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:34.946255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:34.947666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.058874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 486/974] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:11:35.065063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.154736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.174906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145956fd-434e-4662-a0ba-37a68db77efa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.212876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.213839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.214242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.214620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.227395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.227395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:35.245628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:35.246906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:35.248018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:35.248018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:35.248018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:35.248018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:35.249295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 489/975] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:35.254703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.304042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.358340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9506b-0b0e-4894-bf2f-23506cdc12bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.392488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.393143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.393427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.393703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.394444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:35.394752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.396662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96744-dc9d-4b39-adfa-e829ec7fef31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.411573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 487/976] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:35.416962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.500222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87cfd-8a62-4b49-b199-31f2087d1e9a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.500415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87cfd-8a62-4b49-b199-31f2087d1e9a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.500700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87cfd-8a62-4b49-b199-31f2087d1e9a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.502373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 488/977] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:35.507674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3fea3-0a79-42d9-a745-213ab656e051 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.508007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3fea3-0a79-42d9-a745-213ab656e051 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.508299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3fea3-0a79-42d9-a745-213ab656e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.520517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c786-2948-45ee-afa7-5b42c87a3bd9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.525118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-24e3fea3-0a79-42d9-a745-213ab656e051 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:35.526440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-24e3fea3-0a79-42d9-a745-213ab656e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:35.551789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.557633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.558456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.558740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.559017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.565794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.567354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0bb02129-57b0-4ee6-b719-132746ad7e7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:35.582067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:35.583228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:35.584150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:35.586365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 490/978] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:35.587939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9eae-7225-4806-a41b-d59e4b229c00 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.588236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9eae-7225-4806-a41b-d59e4b229c00 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.588516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9eae-7225-4806-a41b-d59e4b229c00 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.589827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 491/979] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:35.590540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf9eae-7225-4806-a41b-d59e4b229c00 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.599478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 489/980] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:35.600827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.601119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.601397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.618189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:35.619400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:35.649253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.687044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 490/981] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:35.687883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.703764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf9eae-7225-4806-a41b-d59e4b229c00 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.737692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.738388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.738677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.738956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.740238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:35.740553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.742000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.754161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 492/982] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:35.754898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.791274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655775-be8a-4388-986e-65a226bd2be4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.807379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.826078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.826912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.827199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.827477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.828997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.829500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:35.841537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:35.842681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:35.843530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:35.844467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 491/983] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:35.844908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.855076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd769cc-0029-4026-aeba-d4612c9c023a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.876578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:35.889184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.891979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.891979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.891979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.891979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.892490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:35.945107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b38e9-35a8-44fe-8af8-30fe4cebdbeb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:35.964135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 493/984] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:35 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:35.965007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:35.993245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:35.994609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:35.995446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:35.995780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:35.996707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] RBAC: Adding query filter params (role.id=35a3914f2f714f2b98152f5101679de5, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=18c8feb5103b47c2a185f2aa32bb37f9) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:35.997302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:35.999364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.008978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 492/985] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/role_assignments?user.id=18c8feb5103b47c2a185f2aa32bb37f9&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=35a3914f2f714f2b98152f5101679de5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:36.110377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68731b46-aae8-4872-9930-a6dadeed8142 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:36.126619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:36.151287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:36.151986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.152277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.152562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.153318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:36.153632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:36.155106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.160994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 494/986] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:36.167473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:36.274413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:36.283722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2381f0-f13e-4d59-a903-7cc1ccf7e328 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:36.319421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:36.320100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.320388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.320671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.321388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:36.321702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:36.323110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.332904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 493/987] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:36.334722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:36.437485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8f79a-00bd-4787-adbd-dcf65a671744 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:36.473077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:36.473077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.473077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.473077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.473497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] RBAC: Adding query filter params (interface=admin, service_id=64f9b5fd7f8d4ec8b0908ac8cc7193a3, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:36.473749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:36.475850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b40be7-a7f0-40f6-bf4c-36cc48227d80 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.482255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 495/988] 10.222.0.61 () {56 vars in 1249 bytes} [Mon Jul 4 09:11:36 2022] GET /identity/v3/endpoints?service_id=64f9b5fd7f8d4ec8b0908ac8cc7193a3&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:36.487620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:36.603980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06ab4-aca4-4493-8382-0d5045f0a5b8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:36.638967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:36.639634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:36.639901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:36.640175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:36.640853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:36.642242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f9099-f929-41e9-8d5a-54f0c49f712a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:36.649678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 494/989] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:36 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:11:38.065507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d150e-930d-42ae-a5a7-2a941d6ed4e9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.066042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d150e-930d-42ae-a5a7-2a941d6ed4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.066147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d150e-930d-42ae-a5a7-2a941d6ed4e9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.067651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 496/990] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:38.072782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.073178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.073360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.090743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:38.098409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:38.106346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.112780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c87e2-c55f-4f14-a6c1-e1c3ff6b290b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.113152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c87e2-c55f-4f14-a6c1-e1c3ff6b290b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.113515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c87e2-c55f-4f14-a6c1-e1c3ff6b290b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.115899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 497/991] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:38.121295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.122298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.122298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.139677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:38.141388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:38.168471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 495/992] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:38.182402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.191881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.220450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 498/993] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:38.242514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.305243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa07c-b97e-4c0b-b7f6-2b505c3b0df5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.344414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.345141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.345431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.345714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.346402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.347779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.349114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5c2be-9c72-4ab7-a7f4-7186f3769be0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:38.360350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:38.361428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:38.362395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 496/994] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:38.367415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.383988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.388258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.389057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.389337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.389607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] PATH_INFO: `/v3/services/image` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.390288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.391663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:38.404238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:38.405228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:38.406106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 499/995] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:38.411517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.448500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.479098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9df0-7cc0-4978-85f6-3286d6078f35 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.515854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.516513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.516839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.517074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.517786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:38.518095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.519507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.524681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 497/996] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:38.527078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7370-636a-47f1-abc3-074c71fbde99 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.530230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.563647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.564324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.564616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.564900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.565730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] RBAC: Adding query filter params (name=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:38.566049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.567468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.573103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 500/997] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:38.578506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.612398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.636434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc76c-2f0e-4f66-a48c-fe9bec56f5ae None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.677466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.678264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.678529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.678802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.679511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:38.679814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.681190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.686588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 498/998] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:38.689569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.692246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.694709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32afb0-cfce-4167-ba5b-542f48e98c2a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.727998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.728669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.728960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.729242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.729953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] RBAC: Adding query filter params (type=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:38.730310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.731706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f1744-f797-45c3-a6f3-52506884470f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.736242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 501/999] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:38.737560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b0f80-8d93-4599-9689-ac70426d07aa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.737860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b0f80-8d93-4599-9689-ac70426d07aa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.738139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b0f80-8d93-4599-9689-ac70426d07aa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.740131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 502/1000] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:38.746101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.746482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.746721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.767274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:38.768527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:38.803737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce22c7f-da2c-43f7-99dd-47235d6f82f8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.841522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:38.842228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:38.842520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:38.842803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:38.843609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] RBAC: Adding query filter params (interface=public, service_id=78073309a226400d9f1cc8076b64a90b, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:38.843925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:38.845327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:38.849942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 503/1001] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:38.856566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 499/1002] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/endpoints?service_id=78073309a226400d9f1cc8076b64a90b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:38.862059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.873957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:38.878515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.965989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:38.976787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099f9e-5df2-41c0-8515-e27e7c7b5b51 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:38.983318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedaf49-bee4-439f-ae21-6f2d5d3dd541 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:39.020972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:39.021652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:39.021938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:39.022247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:39.022947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:39.023320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:39.024144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:39.024329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:39.024424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:39.024700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:39.025543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:39.027450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:39.031256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 504/1003] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:39.041153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:39.042324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:39.043209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 500/1004] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Jul 4 09:11:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:39.055721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:39.170956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7f05-1b34-40e2-a015-187937e2ce58 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:39.209625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:39.210346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:39.210641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:39.210929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:39.211652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:39.211969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:39.213361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:39.219915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 505/1005] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:39.226017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:39.297026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:39.331774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1b7c-3073-4650-8f89-2c15ebaeb09e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:39.366924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:39.367591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:39.367879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:39.368155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:39.368857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:39.369160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:39.370814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8c86f-d062-4c50-910c-5139d940d104 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:39.376089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 501/1006] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Jul 4 09:11:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:39.381636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:39.405147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:39.484225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745c5d-5cce-4db7-8791-0a0d3811cc96 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:39.520516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:39.521702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:39.521990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:39.522330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:39.523078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:39.524458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c2961-0e76-4637-a53a-1c5ae66c9c92 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:39.616295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 506/1007] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:40.808753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac984d-a4d5-4677-9a96-6c736f720c96 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:40.809280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac984d-a4d5-4677-9a96-6c736f720c96 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:40.809356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac984d-a4d5-4677-9a96-6c736f720c96 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:40.810881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 502/1008] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:40.815910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9379f5-0b79-4f99-a091-1b2462203eb5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:40.816338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9379f5-0b79-4f99-a091-1b2462203eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:40.816501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9379f5-0b79-4f99-a091-1b2462203eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:40.834831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2d9379f5-0b79-4f99-a091-1b2462203eb5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:40.836038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2d9379f5-0b79-4f99-a091-1b2462203eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:40.910830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 507/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:40.934399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac984d-a4d5-4677-9a96-6c736f720c96 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.041227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac984d-a4d5-4677-9a96-6c736f720c96 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.072343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.078845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757bf55-1933-4eb8-bdec-5599cd6b5c93 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.079139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757bf55-1933-4eb8-bdec-5599cd6b5c93 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.079267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.079450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757bf55-1933-4eb8-bdec-5599cd6b5c93 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.079916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.080206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.080489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.081019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 508/1010] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:41.081323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.082814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.086112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.086445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.086734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.098009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.104612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:41.105934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:41.153292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 503/1011] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:40 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:41.193419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 509/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:41.216775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.331195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc29be6-33db-4cc4-8eb9-f2559a8c9525 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.366316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.367129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.367418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.367702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.368361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.369992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:41.382108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:41.383270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:41.384148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 504/1013] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:41.391469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.494772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f0b1-89b0-4780-aa3c-150b5e217ee0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.524714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.530494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.531174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.531463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.534989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.534989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:41.534989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.534989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3d4-adce-4bb9-9ee6-ca6011144b20 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.540107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 510/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:41.545616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.606739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.660596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8187b77-e27e-4204-849b-a2b8bb354191 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.688671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45a39-c70b-4f00-93fa-9af1ba6b9e0b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.688961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45a39-c70b-4f00-93fa-9af1ba6b9e0b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.689252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45a39-c70b-4f00-93fa-9af1ba6b9e0b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.690971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 511/1015] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:41.696341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.696632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.696909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.697065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.697702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.697998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.698410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.699345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:41.699669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.701160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.712686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 505/1016] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Jul 4 09:11:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:41.713547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:41.714311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.714769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:41.794536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 512/1017] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:41.813727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:41.816969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec277-9b58-4474-b650-61889ebcfbb9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.841582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.856164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.856884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.857114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.857397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.858137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.859541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.917556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b865-caf0-466b-8f08-acc1ad52b679 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:41.941037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 506/1018] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:41.950655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:41.967489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe317dd-1115-450f-b339-005612ace4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:41.968321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe317dd-1115-450f-b339-005612ace4db None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:41.968603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe317dd-1115-450f-b339-005612ace4db None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:41.968876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe317dd-1115-450f-b339-005612ace4db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:41.970162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe317dd-1115-450f-b339-005612ace4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:41.971682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe317dd-1115-450f-b339-005612ace4db None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:41.974368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 513/1019] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:41.979876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:42.102371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0919-23c4-43ac-a76a-4f3134b567d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:42.141689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:42.142312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:42.142606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:42.142892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:42.143606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:42.145056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bf0e0-62fe-4560-9959-511b09c63808 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:42.280484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 507/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:11:41 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:43.224195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8add95-3448-4d85-ae5a-f2c243b09e1b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.224719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8add95-3448-4d85-ae5a-f2c243b09e1b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.224826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8add95-3448-4d85-ae5a-f2c243b09e1b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.228400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 514/1021] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:43.231740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.232109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.232292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.249302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:43.250530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:43.273523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:43.317954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 508/1022] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:43.341526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8add95-3448-4d85-ae5a-f2c243b09e1b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:43.445653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8add95-3448-4d85-ae5a-f2c243b09e1b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:43.480994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:43.481717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.482007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.482321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] PATH_INFO: `/v3/services/image` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.482982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:43.484360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:43.496481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:43.497458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:43.503124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 515/1023] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:43.503935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:43.604777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f95eb-8a38-477c-8600-159d1d803df1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:43.640521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:43.641192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.641481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.641789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.642554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:43.642865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:43.644253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:43.654819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 509/1024] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:43.656039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:43.715390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:43.762966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591da494-e8c5-424f-83de-3df41eea9980 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:43.796139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:43.796814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.797104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.797386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.798105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] RBAC: Adding query filter params (type=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:43.798447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:43.799841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:43.810766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 516/1025] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:43.812319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:43.839085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:43.921757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5527d9c-decc-4c3e-9779-270038f18137 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:43.958831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:43.959486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:43.959766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:43.960047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:43.960831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] RBAC: Adding query filter params (interface=public, service_id=ffcdb48ae72b48038eb1e8c41f6b363e, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:43.961145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:43.962548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece4e2a-7031-4470-a46f-49e971e0d28e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:43.968214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 510/1026] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/endpoints?service_id=ffcdb48ae72b48038eb1e8c41f6b363e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:43.973578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.079199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747325-0049-4f05-b715-cd66d4317434 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.096816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:44.110899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461153-fe52-4122-a168-dd843b2a3d18 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.111498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461153-fe52-4122-a168-dd843b2a3d18 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.111784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461153-fe52-4122-a168-dd843b2a3d18 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.113566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 511/1027] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:44.118010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.118728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.119082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.119311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742aff-eee6-4c37-add7-99ad64a30802 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.119768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742aff-eee6-4c37-add7-99ad64a30802 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.119897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.120138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742aff-eee6-4c37-add7-99ad64a30802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.120667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.122129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.134438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 517/1028] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:11:43 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:11:44.138156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dd742aff-eee6-4c37-add7-99ad64a30802 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:44.139575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dd742aff-eee6-4c37-add7-99ad64a30802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:44.222974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 512/1029] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:44.248602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.354874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a995962-2fa0-47a0-996a-dd746d1afbf4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.382922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589328af-ba44-41cf-bf2c-f9ffa36c974f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.383436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589328af-ba44-41cf-bf2c-f9ffa36c974f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.383537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589328af-ba44-41cf-bf2c-f9ffa36c974f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.384982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 513/1030] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:44.389547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.389819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.390088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.390423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.390525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.390694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.390966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.402775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:44.407069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:44.408338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:44.411596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:44.412558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:44.413430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:44.417770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 518/1031] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:44.418864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.423641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:44.465937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:44.487793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 514/1032] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:44.512764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.530068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039158-e610-45d3-8929-68c6e15c6f19 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.565795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.566506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.566794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.567075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.567867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:44.568178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.569631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.578508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 519/1033] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:44.584621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.622532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89f297-f7c1-4ae2-bee1-2827981b7b79 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.664399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.665192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.665479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.665757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.666960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.668403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.670287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 515/1034] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:44.675588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.691969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:44.699249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636032-bbf3-40cc-946a-94826fcbc057 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.701641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:44.737333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.738122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.738434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.738717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.749487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.751182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:44.769507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:44.771213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 520/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:44.776969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:44.786663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72069d9-94bd-49fe-a668-6a734be5c23b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.825833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.826540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.826828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.827108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.827816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.829247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.881402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c605-209e-4bf8-9ccb-96ddfe4cb674 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:44.915257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:44.915925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:44.916213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:44.916497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:44.917219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:44.917531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:44.918956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:44.934231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 516/1036] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:11:44 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:44.942647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 521/1037] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:44.943586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.022694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:45.055665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ad63-1418-4084-9d9b-f4523d157af8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.094143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.094987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.095279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.095558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.104096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.105549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:45.120667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:45.128488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:45.129474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 517/1038] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:45.130673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.150035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:45.238019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d59d7f-b4e7-4714-b02a-ef78fe4f266c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.275670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.276448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.276675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.276934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.277799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:45.278115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.279641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.298452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 522/1039] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:45.304406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.407323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bda9c-db1a-4abc-a79c-abe843ad56d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.436622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:45.443768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.444452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.449861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.449861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.518080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.519522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.624904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 518/1040] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:45.626454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.702926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:45.728774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b57d-e2d0-4ee2-acbe-f6c9692c32df None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.764711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.765565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.765878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.766167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.776550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.778013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:45.795945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:45.796887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:45.797797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:45.797797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:45.797797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:45.797797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:45.797797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 523/1041] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:45.804479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:45.835151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:45.911505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b477367-34e0-45ba-8fbf-7b34b403b038 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:45.946162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:45.946853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:45.947147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:45.947428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:45.948150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:45.948467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:45.949833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:45.961573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 519/1042] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:45.967046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.069438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d062-fed1-4358-8c11-42bd12d92828 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.097845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:46.108170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.108993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.109280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.109562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.117829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.119190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bb0d2cc7-b067-4ffa-9741-4e8c3b249308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:46.134919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:46.138185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:46.139371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 524/1043] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:46.142050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.202928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce891-97a9-4a60-8432-00b69a95b2ca None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.203254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce891-97a9-4a60-8432-00b69a95b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.203490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ce891-97a9-4a60-8432-00b69a95b2ca None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.205140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 525/1044] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:46.212045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.212267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.212549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.229933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:46.231161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:46.248222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:46.258343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d357a6-08c9-41d7-9857-e07b58badbf1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.293702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.294396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.294686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.294962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.295741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:46.296059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.297510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.309330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 520/1045] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:46.315545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.315917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 526/1046] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:46.339394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.421354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48555b5-6f2a-4774-9157-025a792c332f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.444149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874134c4-3fe9-4f25-ad16-82c95ae0694a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.457505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.458335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.458623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.458905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.459765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] RBAC: Adding query filter params (role.id=35a3914f2f714f2b98152f5101679de5, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:46.460096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.461524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.461987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:46.478317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 521/1047] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:46 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=35a3914f2f714f2b98152f5101679de5 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:46.481989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.482870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.483159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.483441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] PATH_INFO: `/v3/services/image` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.484128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.485563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:46.499253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:46.500373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:11:46.501227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:46.504902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 527/1048] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Jul 4 09:11:46 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:46.510874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.529974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:46.627870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a01d-f8dc-47eb-b331-052ffa6efa13 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.663608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.664640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.665152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.665629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.666610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:46.667118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.668679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.674510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 522/1049] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:46.680509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.785348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e1ea3-740f-43c8-a31f-9000c32c2642 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.820311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.821131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.821531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.821902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.822755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:46.823166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.824619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77758b7b-76e2-4be4-8923-9211cbb39ac3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:46.834233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 528/1050] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:46.835790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:46.920232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:46.943826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760607de-5c56-4b91-8191-926b5ec4accc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:46.976847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:46.977669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:46.978059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:46.978473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:46.979317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:46.980790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:47.070578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10d10-dc6f-4fcb-bde2-245e89030613 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.070804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10d10-dc6f-4fcb-bde2-245e89030613 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.071086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10d10-dc6f-4fcb-bde2-245e89030613 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.072474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 529/1051] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:47.077761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.078056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.078372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.085231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 523/1052] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:11:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:11:47.096119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:47.097366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:47.148126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:47.187186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 530/1053] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:47.212874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:47.327984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870459d4-f768-4ef3-a03d-79d3f0acdb45 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:47.362501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:47.363697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.364774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.365266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.367363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:47.377571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:47.385531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:47.386556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:47.387433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:47.388101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 524/1054] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:47.394796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:47.495664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1937957-a2bb-4047-9194-95af1c799d37 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:47.530338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:47.531418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.531884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.532340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.533278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:47.533601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:47.535279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:47.548705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 531/1055] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:47.550002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:47.659992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b849-cf9e-4317-a904-b333bd4c51b2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:47.696677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:47.697545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.697830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.698103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] PATH_INFO: `/v3/users/06c50ef9379f48e4bdb9afc16bf7da64` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.711824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] RBAC: Authorizing `identity:get_user(user_id=06c50ef9379f48e4bdb9afc16bf7da64)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:47.713261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:47.718280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 525/1056] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:11:47 2022] GET /identity/v3/users/06c50ef9379f48e4bdb9afc16bf7da64 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:47.721027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:47.752836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:47.823462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66df0-01b7-499c-8067-d14022cec7c0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:47.857598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:47.858272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:47.858556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:47.858831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:47.926032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:47.927480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:47.958535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:48.031729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 532/1057] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:11:48.033289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:48.089689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:48.139948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7320c-b826-4ac2-a48f-4728ea6f1d3c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:48.175817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:48.176772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.177010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.177290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.178504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:48.179942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75cf7a-df4c-4880-9553-b991a45aff0f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:48.182424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 526/1058] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:11:48 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:48.187817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:48.297355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00dc9-1e08-4d3c-8c41-70fb99b59e84 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:48.328081 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:48.333079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:48.333731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.334012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.334327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.335157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab, user.id=06c50ef9379f48e4bdb9afc16bf7da64) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:48.335468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:48.336889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda405f-1528-4f90-9b65-18483b200773 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:48.350492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 533/1059] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:48 2022] GET /identity/v3/role_assignments?user.id=06c50ef9379f48e4bdb9afc16bf7da64&scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:48.519587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daea39-9391-4f6e-add7-5d934eede74c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.519940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daea39-9391-4f6e-add7-5d934eede74c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.520678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daea39-9391-4f6e-add7-5d934eede74c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.522395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 527/1060] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:48.528051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.528621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.528621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.546015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:48.547240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:48.615839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 534/1061] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:48.639334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daea39-9391-4f6e-add7-5d934eede74c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:48.743703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daea39-9391-4f6e-add7-5d934eede74c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:48.765256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:48.781398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:48.782141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.782457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.782732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.793584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:48.802333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:48.803288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:48.804173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:48.806527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 528/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:48.809781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:48.910730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dad46-1b6c-4c82-b8d5-63fdb80c2ead None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:48.937258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:48.946878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:48.950730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:48.962368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 535/1063] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:48.965317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.069996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca0b14-a034-4d3e-b2c1-f8289aa9055c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.106345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.107464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.107854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.108290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.120294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.124296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4e8be4d4-5e5a-440c-b5a1-d984e62b9f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:49.139767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:49.140704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:49.146675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:49.146675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:49.146675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.146675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:49.146675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 529/1064] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:49.148410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.183292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44dbc-bc9a-4ca1-be7a-fce40845ba30 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.183606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44dbc-bc9a-4ca1-be7a-fce40845ba30 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.183846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc44dbc-bc9a-4ca1-be7a-fce40845ba30 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.186097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 530/1065] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:49.190702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.190953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.191195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.214648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:49.215055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:49.247876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.262820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1089-b3f5-4e13-8e33-ed822cfb6c6f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.292572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 531/1066] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:49.297239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.298030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.298251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.298502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.299232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:49.299540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.300929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.318237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 536/1067] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:49.318414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.320252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.376020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.422813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbebc0a-7b89-4249-b27b-39cfa980ff87 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.444487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d5b5-ad04-477f-a8ae-e55104b50f11 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.465119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.466578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.467076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.467803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.482332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.483283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.483570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.483845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.492197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.493402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.501256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:49.509607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:49.512436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:49.513607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 537/1068] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:49.516449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.546027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.547527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.626437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec577e-b4d3-436a-8bdf-07a85edbd765 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.636379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.665050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.665725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.666016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.666332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.671725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 532/1069] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:49.672178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:49.672178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.672178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.672674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.691128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 538/1070] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:49.696601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.744636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.787121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a69a15-95c6-4a3f-b8d7-5abbbec26edd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.805614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b003da-491f-4251-81aa-4fa65c35d430 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.824658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.825454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.825741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.826018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.837557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.839042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.843971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:49.844775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:49.845063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:49.845755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:49.856748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:49.857887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:49.858842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:49.858842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:49.858842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.858842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:49.858842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 533/1071] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:49.860358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:49.861825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:49.863785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:49.884478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:49.885552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:49.886705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:49.886705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:49.886705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:49.886705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:49.888960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 539/1072] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:49.895570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:49.919556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:49.974703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9470c6c-2663-4b55-ba37-30cb078cb971 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:49.989869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:50.003111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453c73-2cce-4c20-bad6-46a159a4e875 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.013767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.015020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.015781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.016249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.017411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:50.018301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.020854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.046233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 534/1073] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:50.049168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.049874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.050166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.050478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.051304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:50.051617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.053065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.066094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 540/1074] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:50.071730 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.183364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b81e2-fdbe-4a27-967b-5c0f103e5fbe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.224706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.228078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.228078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.228078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.233482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.234969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fa5d2617-c275-4a75-abb3-151ebdaef98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:50.249532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:50.250792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:50.251724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 535/1075] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:50.258684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.342802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:50.362247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ca878-029b-4ff1-b69b-8d5c15b1be1b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.362543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ca878-029b-4ff1-b69b-8d5c15b1be1b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.362826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ca878-029b-4ff1-b69b-8d5c15b1be1b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.363860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aff7-1a1a-4e00-9707-fcfb85ab049a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.364243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 536/1076] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:50.369615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.369913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.370210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.387459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:50.388658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:50.401807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.402510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.402794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.403071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.403860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:50.404173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.405607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.418676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 541/1077] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:50.420436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:50.424519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.466234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 537/1078] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:50.486109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.526094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f05f-7656-4629-9c1b-5a45c46c6292 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.560627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.561517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.561808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.562099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/35a3914f2f714f2b98152f5101679de5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.564407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=b0991f43889c4092baff1a5a1099d673, role_id=35a3914f2f714f2b98152f5101679de5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.565848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.585090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d306d-6946-489a-904f-2f1076118b92 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.615518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:50.621297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 542/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:50 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/b0991f43889c4092baff1a5a1099d673/roles/35a3914f2f714f2b98152f5101679de5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:11:50.621852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.622765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.623057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.623343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.637308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:50.645389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:50.646481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:50.647488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 538/1080] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:50.653384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.761586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f371364-246a-42c9-b285-88f42776cc31 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.797214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.797887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.798171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.798482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.799223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:50.799532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.800973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.809874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 543/1081] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:50.815884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:50.842828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:50.916328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf382c74-a278-44c2-ab97-4dbbc8809694 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:50.949667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:50.950455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:50.950739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:50.951013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] PATH_INFO: `/v3/users/06c50ef9379f48e4bdb9afc16bf7da64` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:50.952223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] RBAC: Authorizing `identity:get_user(user_id=06c50ef9379f48e4bdb9afc16bf7da64)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:50.953751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:50.955652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 539/1082] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/users/06c50ef9379f48e4bdb9afc16bf7da64 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:50.961278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:51.022253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:51.064193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41643e1-723c-4217-a25d-42b3a33d9d5f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:51.097754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:51.099204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:51.099483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:51.099755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:51.100939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:51.102407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220e48-f019-41e9-8b43-2a44133a7c4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:51.104256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 544/1083] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:11:50 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:51.109997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:51.201102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:51.209681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725cf53-eec4-4e7d-8b4d-55ed68409429 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:51.245301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:51.246215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:51.246503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:51.246777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab/users/06c50ef9379f48e4bdb9afc16bf7da64/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:51.248737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a47f3f79a1741e9bbd28bcca363f5ab, user_id=06c50ef9379f48e4bdb9afc16bf7da64, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:51.250176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba716-e817-4404-a27f-9a88f3162eb5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:51.335274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 540/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:11:51 2022] PUT /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab/users/06c50ef9379f48e4bdb9afc16bf7da64/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:11:52.657815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537060-6197-4260-8b14-b5bd98502fef None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:52.658334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537060-6197-4260-8b14-b5bd98502fef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:52.658334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537060-6197-4260-8b14-b5bd98502fef None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:52.659863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 545/1085] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:52.665053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:52.665461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:52.665727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:52.682093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:52.683314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:52.749129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 541/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:52.772686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537060-6197-4260-8b14-b5bd98502fef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:52.875537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537060-6197-4260-8b14-b5bd98502fef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:52.901201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:52.908989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:52.909735 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:52.910020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:52.910335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:52.920900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:52.929375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:52.930597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:52.931442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 546/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Jul 4 09:11:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:52.939525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.025639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.044187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c85b5-cbd0-4773-a4de-efb7fd49f330 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.079896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.080567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.080855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.081135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.081885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:53.082247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.083626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.092297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 542/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:11:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:53.097470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.198762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b7d0-47d1-4c30-972a-d94cb443adb0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.234657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.235450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.235732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.236006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.246988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.248428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e634dbfb-9cc1-4535-b5f3-d9443e087313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:53.266384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:53.267333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:53.268369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:53.268369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:53.268369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:53.268369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:53.268369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 547/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:53.273378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.357648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfa31-e95f-4332-a47b-c836ae86673e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.357935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfa31-e95f-4332-a47b-c836ae86673e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.358267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfa31-e95f-4332-a47b-c836ae86673e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.359650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 548/1090] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:11:53.365701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.365994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.366313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.373204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9c6d-58c0-4c97-9718-d806c6316fe5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.383085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:53.384155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:53.407139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.407803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.408090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.408373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.409092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:53.409403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.411347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.418615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.423607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 543/1091] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:53.429938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.440123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.452389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 549/1092] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:11:53.476319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.529369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5036d-9b42-4efb-8c04-0b34c522592d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.563631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.564419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.564704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.565015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.572493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.573938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.576983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aa752-f386-4e02-b991-f5e3e55e09b7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:11:53.588759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:53.589750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:53.591113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 544/1093] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:53.595784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.611449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.612249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.612538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.612819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.624789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:11:53.632626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:53.633702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:11:53.634601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 550/1094] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:53.639991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.661023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.672069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.698763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5a1ae-be48-4da8-814d-351fb6b46988 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.734933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.735826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.736197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.736481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.737327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:53.737642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.739224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.745499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464c758-ac37-4fc5-9586-99145b0498b8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.757230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 545/1095] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:53.763084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.781117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.781805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.782092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.782401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.783153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:53.783467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.784847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.793646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 551/1096] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:53.799381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.874614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0819f6-9c1c-4bdf-9b03-414e49d3a05b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.899561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.900533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:53.909573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469dd21-c25e-46f4-8456-50807fb586d0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:53.911496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.912152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.912440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.912721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.944394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:53.945290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:53.945579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:53.945868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] PATH_INFO: `/v3/users/06c50ef9379f48e4bdb9afc16bf7da64` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:53.947149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] RBAC: Authorizing `identity:get_user(user_id=06c50ef9379f48e4bdb9afc16bf7da64)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.948649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:53.950737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 552/1097] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/users/06c50ef9379f48e4bdb9afc16bf7da64 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:53.956202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:53.986333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:53.988020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.057259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a340f-b1b0-49bd-a801-249dc3c41eeb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.087707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 546/1098] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:11:54.092736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.093398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.093501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.093689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.093974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.116147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.121748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.161736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.163238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.194030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31309f77-e929-4434-9c9e-5ecc5a678cb6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.232389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.233185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.233470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.233750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.244527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.245920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:11:54.264417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:54.265547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:54.266775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:11:54.266775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:11:54.266775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:11:54.266775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:54.266775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 547/1099] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:11:54.271711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.275801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 553/1100] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:11:54.281346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.338167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.347381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.372047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27918c-fea3-4949-947d-0716ca673fb6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.378560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4dd9f-50ec-4e5b-b78e-bc23f91e0547 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.406862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.407527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.407817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.408101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.408825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:54.409141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.410564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.412654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.413514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.413796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.414076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.415326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.416737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.418476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 554/1101] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:54.426812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 548/1102] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:54.426963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.427850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.522602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a592d3b-9e00-4d91-9f62-8a30a354b074 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.524888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e516-7b5c-4fce-932d-f002ff29c660 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.548299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.556573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.560843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.560843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.560843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.561077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.561176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab, user.id=06c50ef9379f48e4bdb9afc16bf7da64) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:54.561251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.561320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.561387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.561387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.561536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.561608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:54.566223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 555/1103] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/role_assignments?user.id=06c50ef9379f48e4bdb9afc16bf7da64&scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:11:54.567422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.569023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:11:54.584550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:11:54.585561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:11:54.586633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 549/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:11:54.592169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.701798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b9b1-13a8-43b6-967b-d046f9bc0743 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.738015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.739377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.739656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.739931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.740716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:54.741058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.742496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a732-5970-4b88-8c76-594d959ece0d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.754969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 556/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:54.761153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:54.865082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aad7f-f17e-4af7-80fe-6bbeefa297e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:54.899400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:54.900056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:54.900343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:54.900623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:54.901457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] RBAC: Adding query filter params (role.id=35a3914f2f714f2b98152f5101679de5, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=b0991f43889c4092baff1a5a1099d673) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:11:54.901775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:54.903249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b88b11-f713-4aa0-bdba-5e6f2a314f87 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:54.909387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 550/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:11:54 2022] GET /identity/v3/role_assignments?user.id=b0991f43889c4092baff1a5a1099d673&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=35a3914f2f714f2b98152f5101679de5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:56.646255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948f6bd-32f3-4a96-8b20-a3d257d37d2f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:56.646911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948f6bd-32f3-4a96-8b20-a3d257d37d2f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:56.646911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948f6bd-32f3-4a96-8b20-a3d257d37d2f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:56.648090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 557/1107] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:56.653204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:56.653628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:56.653752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:56.670638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:56.671812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:56.723295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:56.736627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 551/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:56.761717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948f6bd-32f3-4a96-8b20-a3d257d37d2f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:56.815084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:56.871134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948f6bd-32f3-4a96-8b20-a3d257d37d2f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:56.904942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:56.905668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:56.905963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:56.906265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:56.907454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:56.908895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1977939-71be-440f-b216-0cfa9e1f70ce None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:56.910580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 558/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:56.916373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:57.011543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab0d2a-5869-4845-a79c-0d4a447efc60 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:57.045404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:57.046070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:57.046383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:57.046665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:57.047372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:57.048814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ebb5-36ba-4dc2-a0e9-49c7e6aee315 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:57.162843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 552/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:11:56 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:11:59.213418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183df8-97c1-4a80-8d62-38cf95af4ac6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:59.213970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183df8-97c1-4a80-8d62-38cf95af4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:59.213970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183df8-97c1-4a80-8d62-38cf95af4ac6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:59.215376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 559/1111] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:11:59.220702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:59.221115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:59.221254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:59.237811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:11:59.239015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:11:59.278645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:59.303683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 553/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:11:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:11:59.328282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183df8-97c1-4a80-8d62-38cf95af4ac6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:59.426880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183df8-97c1-4a80-8d62-38cf95af4ac6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:59.447514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:59.461514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:59.465162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:59.465162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:59.465162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] PATH_INFO: `/v3/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:59.465162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] RBAC: Authorizing `identity:get_role(role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:59.465853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:59.467277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 560/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:11:59 2022] GET /identity/v3/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:59.473142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:59.570643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622575-ef13-4af8-97d0-2516523a48c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:59.603201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:59.604061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:59.604341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:59.604618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] PATH_INFO: `/v3/users/ef6320ad502a44d59a39fa7f8c554084` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:59.617676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] RBAC: Authorizing `identity:get_user(user_id=ef6320ad502a44d59a39fa7f8c554084)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:59.619396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:59.621036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 554/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:11:59 2022] GET /identity/v3/users/ef6320ad502a44d59a39fa7f8c554084 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:11:59.627895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:59.726374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7d13-1590-4978-931b-4414aba23429 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:11:59.760084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:11:59.760726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:11:59.761014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:11:59.761296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:11:59.814100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:59.826900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:11:59.834246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:11:59.924597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 561/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:11:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:11:59.930839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:11:59.961299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.029892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637749-185e-4a19-8a36-ba1680980942 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:00.063456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:00.064316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:00.064599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:00.064874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:00.066060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:00.067556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e562ba-24b1-4cfc-9392-d47fce51d5d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:00.069249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 555/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:11:59 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:00.075333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:00.161087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.172295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149274b-1787-4191-b6af-e5b0ec3cb70b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:00.207257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:00.207910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:00.208194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:00.208469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:00.209292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab, user.id=ef6320ad502a44d59a39fa7f8c554084) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:00.209605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:00.211068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f74f8-d809-4c99-b7b6-f7704512ec8f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:00.216556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 562/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:00 2022] GET /identity/v3/role_assignments?user.id=ef6320ad502a44d59a39fa7f8c554084&scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:02.258718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698e8b-a27b-4cd9-873e-e0af33aab432 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.259183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698e8b-a27b-4cd9-873e-e0af33aab432 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.259293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698e8b-a27b-4cd9-873e-e0af33aab432 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.260654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 556/1118] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:02.265982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.266441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.266573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.283437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:02.285132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:02.350653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 563/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:02.374975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26698e8b-a27b-4cd9-873e-e0af33aab432 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:02.470278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:02.474479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26698e8b-a27b-4cd9-873e-e0af33aab432 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:02.512046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:02.512782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.513067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.513344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] PATH_INFO: `/v3/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.514903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] RBAC: Authorizing `identity:get_role(role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:02.516322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:02.517707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 557/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:02 2022] GET /identity/v3/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:02.524147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:02.603156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:02.620298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c3baf-9695-41bb-a8e9-8f83f0ad09af None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:02.654000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:02.655047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.655329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.655603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] PATH_INFO: `/v3/users/ef6320ad502a44d59a39fa7f8c554084` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.656790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] RBAC: Authorizing `identity:get_user(user_id=ef6320ad502a44d59a39fa7f8c554084)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:02.658239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:02.660478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 564/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:02 2022] GET /identity/v3/users/ef6320ad502a44d59a39fa7f8c554084 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:02.666766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:02.765530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89847f0-8e08-4e3f-8551-a75e5ece2cfa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:02.799878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:02.800791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.801103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.801384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.802608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:02.804061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8475df-590b-4820-ae89-1e6c66675b8a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:02.805807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 558/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:02 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:02.811959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:02.911457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3f9f-96cf-4fe2-8d02-25f8b0b43954 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:02.945049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:02.945936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:02.946245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:02.946527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab/users/ef6320ad502a44d59a39fa7f8c554084/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:02.948746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=1a47f3f79a1741e9bbd28bcca363f5ab, user_id=ef6320ad502a44d59a39fa7f8c554084, role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:02.950302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506378-6ce7-47da-b20a-dc941151c1ab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:03.042962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 565/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:12:02 2022] PUT /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab/users/ef6320ad502a44d59a39fa7f8c554084/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:12:05.061755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad1d0-6b3e-42ea-95e9-28b7fce420e7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.062383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad1d0-6b3e-42ea-95e9-28b7fce420e7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.062383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad1d0-6b3e-42ea-95e9-28b7fce420e7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.063727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 559/1124] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:05.069584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.070033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.070143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.086759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:05.087965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:05.090779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:05.154524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 566/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:12:05.179373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad1d0-6b3e-42ea-95e9-28b7fce420e7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:05.214714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:05.286319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad1d0-6b3e-42ea-95e9-28b7fce420e7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:05.319321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:05.320105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.320386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.320662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] PATH_INFO: `/v3/roles/16c083e4e9e44760852a48d71bf1cc48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.322118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] RBAC: Authorizing `identity:get_role(role_id=16c083e4e9e44760852a48d71bf1cc48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:05.323532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:05.324893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 560/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:05 2022] GET /identity/v3/roles/16c083e4e9e44760852a48d71bf1cc48 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:05.330675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:05.426801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee021-00e3-4b9e-9ab0-6eb4dac1c758 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:05.459329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:05.460191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.460476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.460755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] PATH_INFO: `/v3/users/ef6320ad502a44d59a39fa7f8c554084` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.461942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] RBAC: Authorizing `identity:get_user(user_id=ef6320ad502a44d59a39fa7f8c554084)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:05.463415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:05.465028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 567/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:05 2022] GET /identity/v3/users/ef6320ad502a44d59a39fa7f8c554084 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:05.470800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:05.568969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56af54-19d8-4543-ad3c-dad1d7549d48 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:05.571331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:05.602270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:05.602913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.603198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.603474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.669955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:05.671436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:05.766595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 561/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:05.772928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:05.783414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:05.872794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bffd35-78b5-4ae1-bbc2-9fdf283da36a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:05.906207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:05.907066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:05.907349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:05.907631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] PATH_INFO: `/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:05.908813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] RBAC: Authorizing `identity:get_project(project_id=1a47f3f79a1741e9bbd28bcca363f5ab)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:05.910297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8824f0-f318-466a-9527-7224f0149f4e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:05.912190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 568/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:05 2022] GET /identity/v3/projects/1a47f3f79a1741e9bbd28bcca363f5ab => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:05.918103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:05.921236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:06.015528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e5e2-e5ef-4280-a991-5e8011c5f05d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:06.050007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:06.050684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:06.050973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:06.051256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:06.052078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] RBAC: Adding query filter params (role.id=16c083e4e9e44760852a48d71bf1cc48, scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab, user.id=ef6320ad502a44d59a39fa7f8c554084) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:06.052393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:06.053831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110dbf1-895c-48e5-a4fb-255bbecc49f0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:06.059575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 562/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:05 2022] GET /identity/v3/role_assignments?user.id=ef6320ad502a44d59a39fa7f8c554084&scope.project.id=1a47f3f79a1741e9bbd28bcca363f5ab&role.id=16c083e4e9e44760852a48d71bf1cc48 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:08.118053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af62a3-560c-40ef-bda6-eb87039df71d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:08.118742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af62a3-560c-40ef-bda6-eb87039df71d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:08.118742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af62a3-560c-40ef-bda6-eb87039df71d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:08.120296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 569/1131] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:08.125532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:08.125965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:08.126096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:08.142852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:08.144106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:08.206073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:08.211889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 563/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:08.235915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af62a3-560c-40ef-bda6-eb87039df71d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:08.312356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:08.334772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af62a3-560c-40ef-bda6-eb87039df71d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:08.375194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:08.375912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:08.376201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:08.376480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:08.377657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:08.379158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc3ad-88d4-42db-a146-b91754534ae1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:08.380793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 570/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:08.386678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:08.483043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cee52f-726b-4514-b6b7-95cc19986229 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:08.517736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:08.518416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:08.519228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:08.519509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:08.520232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:08.521662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725adde5-b5e9-4c6b-9f87-6d441c108b40 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:08.632913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 564/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:12:08 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:12:10.679584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09024-c67e-4989-a25a-1cd2c40ec1dc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:10.680067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09024-c67e-4989-a25a-1cd2c40ec1dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:10.680067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09024-c67e-4989-a25a-1cd2c40ec1dc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:10.681440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 571/1135] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:10.686518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:10.686909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:10.687083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:10.703719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:10.704909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:10.750506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:10.770935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 565/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:10.796588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf09024-c67e-4989-a25a-1cd2c40ec1dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:10.899245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf09024-c67e-4989-a25a-1cd2c40ec1dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:10.932270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:10.933031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:10.933284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:10.933569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:10.934784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:10.936225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49521e37-a2a1-4639-a6d2-2f66edf44ee7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:10.937852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 572/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:10.943623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:11.044842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8d9c4-e4fc-4352-8058-466dbb29c589 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:11.077820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:11.078514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:11.078806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:11.079087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:11.079796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:11.081837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5897c1-1141-417d-aca3-c271e4f009b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:11.173571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 566/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:12:10 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:12:13.221877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce565-05f4-4e49-91f9-b58e343583c3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.222581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce565-05f4-4e49-91f9-b58e343583c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.222581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce565-05f4-4e49-91f9-b58e343583c3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:13.223858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 573/1139] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:13.229166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.229525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.229685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:13.246863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:13.248060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:13.276763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:13.314843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 567/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:13.338814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce565-05f4-4e49-91f9-b58e343583c3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:13.353852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:13.440474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce565-05f4-4e49-91f9-b58e343583c3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:13.473662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:13.474415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.474704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.475037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:13.484887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:13.493058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:13.494553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:13.495801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 574/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:13.500535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:13.596280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac557-1ee0-48bd-964a-b4a688ee2845 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:13.630970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:13.631652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.631938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.632272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:13.633030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:13.633343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:13.634780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:13.643342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 568/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:13.649095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:13.718077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:13.748911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf715-dfc6-4051-b9cd-fd3537915124 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:13.781521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:13.782412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.782697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.782974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] PATH_INFO: `/v3/users/74ccdc1618b04fa1ba768367b2f70720` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:13.796374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] RBAC: Authorizing `identity:get_user(user_id=74ccdc1618b04fa1ba768367b2f70720)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:13.797826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:13.799625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 575/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:13 2022] GET /identity/v3/users/74ccdc1618b04fa1ba768367b2f70720 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:13.805426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:13.834567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:13.906144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f08b8-b7bb-4eed-afd2-3d5a3069d1e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:13.939579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:13.940227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:13.940514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:13.940795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.007555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:14.008922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:14.035636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:14.106391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 569/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:14.112458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:14.218325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dcd38-4112-4d2c-86df-5eb4f0932fde None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:14.246529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:14.252213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:14.255559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:14.255559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:14.255559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] PATH_INFO: `/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.255559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] RBAC: Authorizing `identity:get_project(project_id=6c7e62d7c1ec48599c1d2edf52ca8002)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:14.256790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efdf7a-2e62-4d72-aa37-1487fa625408 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:14.258616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 576/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:14 2022] GET /identity/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:14.264618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:14.362178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd29e7b-799e-4f69-9e96-8040c53334db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:14.387719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:14.395897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:14.396546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:14.398557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:14.398557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:14.398557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=6c7e62d7c1ec48599c1d2edf52ca8002, user.id=74ccdc1618b04fa1ba768367b2f70720) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:14.398557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:14.399644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8bc9-6c10-40bf-af9a-bf64b93981bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:14.404931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 570/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:14 2022] GET /identity/v3/role_assignments?user.id=74ccdc1618b04fa1ba768367b2f70720&scope.project.id=6c7e62d7c1ec48599c1d2edf52ca8002&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:16.411103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db2e9-00a0-4d16-9219-94c0a38e3eb4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.411640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db2e9-00a0-4d16-9219-94c0a38e3eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.411640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db2e9-00a0-4d16-9219-94c0a38e3eb4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.413003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 577/1147] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:16.418279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.418677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.418847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.435232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:16.436440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:16.500728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 571/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:12:16.523761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db2e9-00a0-4d16-9219-94c0a38e3eb4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:16.622094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db2e9-00a0-4d16-9219-94c0a38e3eb4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:16.656431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:16.657216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.657499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.657775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.667922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:16.675543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:16.676643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:16.677674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 578/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:16.683006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:16.781868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ca2a-7737-40db-97ca-4f3bca512f41 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:16.804812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:16.816916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:16.818298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.818298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.818298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.818982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:16.819298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:16.820673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:16.828681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 572/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:16.835040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:16.893582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:16.934520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b8852-7695-45f4-b713-5a305b4325ad None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:16.969065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:16.969930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:16.970236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:16.970521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] PATH_INFO: `/v3/users/74ccdc1618b04fa1ba768367b2f70720` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:16.971727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] RBAC: Authorizing `identity:get_user(user_id=74ccdc1618b04fa1ba768367b2f70720)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:16.973157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:16.974805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 579/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:16 2022] GET /identity/v3/users/74ccdc1618b04fa1ba768367b2f70720 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:16.980622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:17.078282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad0c-36be-4103-8f47-71e86f373726 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:17.110452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:17.111292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:17.111572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:17.112496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] PATH_INFO: `/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:17.113663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] RBAC: Authorizing `identity:get_project(project_id=6c7e62d7c1ec48599c1d2edf52ca8002)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:17.115117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2001b0-739d-4d91-a14f-64ab3a1c13a5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:17.116803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 573/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:16 2022] GET /identity/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:17.123039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:17.219677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935b09f-7eed-46f1-ad28-a6ba4698fd36 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:17.245090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:17.254251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:17.255143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:17.255426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:17.255706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] PATH_INFO: `/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002/users/74ccdc1618b04fa1ba768367b2f70720/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:17.257681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c7e62d7c1ec48599c1d2edf52ca8002, user_id=74ccdc1618b04fa1ba768367b2f70720, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:17.259228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753850ff-d675-4d31-9907-9b53adf14886 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:17.339989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 580/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:12:17 2022] PUT /identity/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002/users/74ccdc1618b04fa1ba768367b2f70720/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:12:19.358224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8367-fd3f-4031-b223-54b546b6405f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:19.358742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8367-fd3f-4031-b223-54b546b6405f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:19.358858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8367-fd3f-4031-b223-54b546b6405f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:19.360150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 574/1154] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:19.365814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:19.366214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:19.366412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:19.383236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:19.384428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:19.449349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 581/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:19.475487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8367-fd3f-4031-b223-54b546b6405f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:19.529356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:19.576865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8367-fd3f-4031-b223-54b546b6405f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:19.608913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:19.609710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:19.609993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:19.610289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:19.620917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:19.629044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:19.630242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:12:19.631462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 575/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:19.636337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:19.733196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f74dd-cd6b-404c-879e-ec033d624d01 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:19.749968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:19.767979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:19.768646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:19.768937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:19.769220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:19.769968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:19.770318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:19.771692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:19.780624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 582/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:19.785880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:19.886062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c975-3ad3-4a5d-8bbf-b598b419b3ee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:19.898653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:19.918694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:19.919555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:19.919844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:19.920123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] PATH_INFO: `/v3/users/74ccdc1618b04fa1ba768367b2f70720` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:19.921321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] RBAC: Authorizing `identity:get_user(user_id=74ccdc1618b04fa1ba768367b2f70720)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:19.922838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:19.924992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 576/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:19 2022] GET /identity/v3/users/74ccdc1618b04fa1ba768367b2f70720 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:19.930876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:20.028504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bc57-ad08-437a-9e3f-a3eb61e4d642 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:20.061149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:20.061729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:20.062018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:20.062332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:20.107865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:20.130597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:20.132069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:20.231215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 583/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:20.237042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:20.336327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cc66-0750-4e94-97ab-0db6f627854b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:20.368955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:20.369809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:20.370092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:20.377929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] PATH_INFO: `/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:20.377929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] RBAC: Authorizing `identity:get_project(project_id=6c7e62d7c1ec48599c1d2edf52ca8002)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:20.377929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ce1d-e820-4e42-aa5c-16bbee661d51 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:20.377929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 577/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:20 2022] GET /identity/v3/projects/6c7e62d7c1ec48599c1d2edf52ca8002 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:20.381392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:20.460700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:20.481615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c7fb-43fd-4e6c-9b8d-be88458fb256 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:20.515719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:20.516336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:20.516625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:20.516901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:20.518240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=6c7e62d7c1ec48599c1d2edf52ca8002, user.id=74ccdc1618b04fa1ba768367b2f70720) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:20.518566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:20.519998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b29f4-4d56-4013-a894-4994ea38d8ea None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:20.525688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 584/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:20 2022] GET /identity/v3/role_assignments?user.id=74ccdc1618b04fa1ba768367b2f70720&scope.project.id=6c7e62d7c1ec48599c1d2edf52ca8002&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:22.548196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd01fd-1caa-4093-87ff-af8a3ea561bb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:22.548699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd01fd-1caa-4093-87ff-af8a3ea561bb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:22.548699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd01fd-1caa-4093-87ff-af8a3ea561bb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:22.550025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 578/1162] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:22.555152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:22.555583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:22.555710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:22.573167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:22.574374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:22.639312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 585/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:22.662133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd01fd-1caa-4093-87ff-af8a3ea561bb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:22.712311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:22.763687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd01fd-1caa-4093-87ff-af8a3ea561bb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:22.795560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:22.796195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:22.796483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:22.796763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:22.862538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:22.863924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:22.909563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:22.959785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 579/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:22.966177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:23.035802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:23.065842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463ef1-89fb-47bf-93ed-5cfc86a95781 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:23.099536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:23.100337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:23.100619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:23.100892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:23.107382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:23.108814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dce72dbf-19e8-48c6-894e-8a80edf00c9a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:23.123668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:23.124901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:12:23.125986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:23.130208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 586/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:12:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:12:23.131425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:23.227992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fa-6c34-49c7-b574-33134faa6bbf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:23.261922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:23.262623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:23.262919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:23.263201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:23.263923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:23.264234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:23.265614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a490a76-f086-41f0-b7af-b31a7f2da2c7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:23.273436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 580/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Jul 4 09:12:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:25.277303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4347de-725e-4a03-a3fd-d6d52cd2508f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.277776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4347de-725e-4a03-a3fd-d6d52cd2508f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.277883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4347de-725e-4a03-a3fd-d6d52cd2508f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.279315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 587/1167] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:25.284502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60b2d-c970-422d-8b03-4c2300eee4c4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.284916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60b2d-c970-422d-8b03-4c2300eee4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.285062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60b2d-c970-422d-8b03-4c2300eee4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.302591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f5c60b2d-c970-422d-8b03-4c2300eee4c4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:25.303778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f5c60b2d-c970-422d-8b03-4c2300eee4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:25.310917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:25.370266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 581/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:25.392851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4347de-725e-4a03-a3fd-d6d52cd2508f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:25.492329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4347de-725e-4a03-a3fd-d6d52cd2508f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:25.519619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:25.524345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:25.524997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:25.525279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:25.525591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:25.526332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:25.527782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566d6c-1423-434b-82d5-1a7f6f18aa0e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:25.602795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 588/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Mon Jul 4 09:12:25 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:12:27.676585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c93-e1eb-4942-bfa3-e6e42157f363 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:27.677140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c93-e1eb-4942-bfa3-e6e42157f363 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:27.677140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c93-e1eb-4942-bfa3-e6e42157f363 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:27.678501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 582/1170] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:27.683626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:27.684029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:27.684184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:27.701639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:27.702917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:27.769117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 589/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:27.792714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451c93-e1eb-4942-bfa3-e6e42157f363 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:27.893248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451c93-e1eb-4942-bfa3-e6e42157f363 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:27.925455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:27.926334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:27.926671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:27.926899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] PATH_INFO: `/v3/domains/de0cb0e1e34f4863beff0d24f3512c15` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:27.937013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=de0cb0e1e34f4863beff0d24f3512c15)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:27.938485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede51b6a-1965-4cc4-b61b-0bc97debd590 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:27.940646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 583/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Mon Jul 4 09:12:27 2022] GET /identity/v3/domains/de0cb0e1e34f4863beff0d24f3512c15 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:27.946711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:28.042183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ff729-3196-473a-81e6-a6a11b503cae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:28.065298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:28.076540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:28.084470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:28.084470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:28.084470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:28.084470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:28.084470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc58c29-286a-47fe-b8f5-79e4c755c1db None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:28.214278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 590/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:12:27 2022] POST /identity/v3/projects => generated 361 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:12:30.249444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39d51-d373-4241-9f4d-a7693bbca39a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:30.249915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39d51-d373-4241-9f4d-a7693bbca39a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:30.250016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39d51-d373-4241-9f4d-a7693bbca39a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:30.251498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 584/1174] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:30.257379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:30.257787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:30.257945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:30.274428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:30.275622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:30.340046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 591/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:30.365479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf39d51-d373-4241-9f4d-a7693bbca39a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:30.368715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:30.469297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf39d51-d373-4241-9f4d-a7693bbca39a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:30.504931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:30.505722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:30.506008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:30.506317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] PATH_INFO: `/v3/domains/de0cb0e1e34f4863beff0d24f3512c15` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:30.507508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=de0cb0e1e34f4863beff0d24f3512c15)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:30.508952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8819-9605-4f30-af79-ad509a3783bb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:30.510681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 585/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Mon Jul 4 09:12:30 2022] GET /identity/v3/domains/de0cb0e1e34f4863beff0d24f3512c15 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:30.516508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:30.619912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9447065-ebfe-4b35-9ce9-f4350ab3102d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:30.622264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:30.653488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:30.654225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:30.654517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:30.654789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:30.655491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:30.656924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71284f64-d5fa-4805-bd0d-1424d83ff30f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:30.760442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 592/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:12:30 2022] POST /identity/v3/users => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:12:32.834507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566708-7b74-4564-9761-235f4df41f21 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:32.835075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566708-7b74-4564-9761-235f4df41f21 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:32.835075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566708-7b74-4564-9761-235f4df41f21 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:32.836445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 586/1178] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:32.841513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:32.841947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:32.842056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:32.859073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:32.860293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:32.925865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 593/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:32.948953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566708-7b74-4564-9761-235f4df41f21 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.020113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:33.051636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566708-7b74-4564-9761-235f4df41f21 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:33.085203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:33.085922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:33.086230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:33.086514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:33.097191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:33.104923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:33.106212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:12:33.107654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 587/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:33.112911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.200250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:33.210324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f84f0-696c-4ff0-8965-bfef1bcdc130 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:33.245274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:33.245950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:33.246261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:33.246548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:33.247306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:33.247623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:33.249009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:33.257867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 594/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:33.263302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.360014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdff2e-4cae-4d5e-9669-a01c7533e0ae None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:33.390310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:33.396175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:33.397046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:33.397334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:33.397611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] PATH_INFO: `/v3/users/670c00ad0c5849ad8817c6c44d712eac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:33.410783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] RBAC: Authorizing `identity:get_user(user_id=670c00ad0c5849ad8817c6c44d712eac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:33.412318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:33.413994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 588/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:33 2022] GET /identity/v3/users/670c00ad0c5849ad8817c6c44d712eac => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:33.419878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.517474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ada3d-a897-4a3a-8e14-d04cdc3cf273 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:33.550444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:33.551111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:33.551397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:33.551677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:33.573138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:33.619397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:33.620784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:33.722663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 595/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:33.728597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.827236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542705f-7ff0-4225-878d-f859b584ba1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:33.861150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:33.862007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:33.862368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:33.862649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] PATH_INFO: `/v3/projects/33761a9d3a674837be36ae61b1c103be` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:33.863829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] RBAC: Authorizing `identity:get_project(project_id=33761a9d3a674837be36ae61b1c103be)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:33.865257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc6f5-7923-4845-a96c-96d86eea30ae None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:33.867004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 589/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:33 2022] GET /identity/v3/projects/33761a9d3a674837be36ae61b1c103be => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:12:33.873394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:33.925140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:33.970802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d0b4-c464-4a82-be84-8c0725bb5e88 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:34.005268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:34.005911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:34.006217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:34.006504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:34.007333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=33761a9d3a674837be36ae61b1c103be, user.id=670c00ad0c5849ad8817c6c44d712eac) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:34.007647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:34.009069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c34774-5dfe-45c9-8323-9d1266fe5983 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:34.014538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 596/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:33 2022] GET /identity/v3/role_assignments?user.id=670c00ad0c5849ad8817c6c44d712eac&scope.project.id=33761a9d3a674837be36ae61b1c103be&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:36.004129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596401-6933-4674-bdbc-3989db91135a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.004684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596401-6933-4674-bdbc-3989db91135a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.004684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596401-6933-4674-bdbc-3989db91135a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.006066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 590/1186] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:36.011276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.011704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.011836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.028901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:36.030090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:36.095555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 597/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:12:36.118869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7596401-6933-4674-bdbc-3989db91135a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:36.175511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:36.219229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7596401-6933-4674-bdbc-3989db91135a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:36.254260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:36.255019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.255311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.255588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.266248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:36.273962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:36.275068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:12:36.280790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 591/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:36.281634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:36.326353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:36.376917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860ccf-16c4-4e66-b775-10e6e7b4cc95 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:36.409557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:36.410249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.410542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.410826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.411572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:36.411884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:36.413265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:36.421156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 598/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:36.427472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:36.526708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2a5a-4d2f-4e03-b725-d56e6c96f659 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:36.542268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:36.559936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:36.561589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.561589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.561589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] PATH_INFO: `/v3/users/670c00ad0c5849ad8817c6c44d712eac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.562577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] RBAC: Authorizing `identity:get_user(user_id=670c00ad0c5849ad8817c6c44d712eac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:36.564596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:36.566234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 592/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:36 2022] GET /identity/v3/users/670c00ad0c5849ad8817c6c44d712eac => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:36.572002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:36.672174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec811-29e3-4ddf-8a53-b5934842b983 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:36.680829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:36.705871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:36.706761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.707047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.707327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] PATH_INFO: `/v3/projects/33761a9d3a674837be36ae61b1c103be` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.708700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=33761a9d3a674837be36ae61b1c103be)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:36.710520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749cd5-aad4-48ed-8dcb-733a11f42fe6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:36.712588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 599/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:36 2022] GET /identity/v3/projects/33761a9d3a674837be36ae61b1c103be => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:36.718173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:36.816669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f837ba-09b8-42b9-a326-d2b127bc481a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:36.850519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:36.851398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:36.851682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:36.851957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] PATH_INFO: `/v3/projects/33761a9d3a674837be36ae61b1c103be/users/670c00ad0c5849ad8817c6c44d712eac/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:36.853906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=33761a9d3a674837be36ae61b1c103be, user_id=670c00ad0c5849ad8817c6c44d712eac, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:36.855375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0108c-7ba5-4073-ab2c-a15f7ed883d7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:36.944128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 593/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:12:36 2022] PUT /identity/v3/projects/33761a9d3a674837be36ae61b1c103be/users/670c00ad0c5849ad8817c6c44d712eac/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:12:38.952792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0450-56cd-4097-9ae0-f9de96b7b737 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:38.953362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0450-56cd-4097-9ae0-f9de96b7b737 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:38.953362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0450-56cd-4097-9ae0-f9de96b7b737 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:38.954809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 600/1193] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:12:38.959896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:38.960338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:38.960445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:38.977470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:12:38.978692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:12:39.018900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:39.045596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 594/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:12:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:12:39.070928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0450-56cd-4097-9ae0-f9de96b7b737 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:39.171139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0450-56cd-4097-9ae0-f9de96b7b737 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:39.204831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:39.205540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:39.205824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:39.206097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:39.216933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:12:39.224618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:12:39.225789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:12:39.226695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 601/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:12:39.231934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:39.329155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f451a9-adab-484d-b8ff-12845274bb56 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:39.361869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:39.362546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:39.362836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:39.363112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:39.363852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:39.364159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:39.365518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:39.373614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 595/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:39.380076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:39.413957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:39.476984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e925d-4a69-4834-85b7-0c6deaf2934d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:39.510564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:39.511421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:39.511704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:39.511978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] PATH_INFO: `/v3/users/670c00ad0c5849ad8817c6c44d712eac` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:39.513173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] RBAC: Authorizing `identity:get_user(user_id=670c00ad0c5849ad8817c6c44d712eac)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:39.514643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:39.516273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 602/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/users/670c00ad0c5849ad8817c6c44d712eac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:39.522125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:39.558307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:39.622978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffc57-2aba-4a9c-a494-8e936494d08a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:39.656788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:39.657978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:39.658295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:39.658581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:39.727303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:39.728672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:39.761793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:39.824808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 596/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:39.830709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:39.932115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e95f1-16a1-4ffd-a41f-d7f04159273e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:39.934470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:39.965201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:39.966069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:39.966389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:39.966670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] PATH_INFO: `/v3/projects/33761a9d3a674837be36ae61b1c103be` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:39.967869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] RBAC: Authorizing `identity:get_project(project_id=33761a9d3a674837be36ae61b1c103be)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:39.969301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c094a-2a1d-48d1-b2b8-951a0ea5b152 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:39.971628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 603/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/projects/33761a9d3a674837be36ae61b1c103be => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:39.977804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:12:40.075438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a96fb-46ed-496d-947e-51d8789ca314 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:12:40.109338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:12:40.109985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:12:40.110328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:12:40.110606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:12:40.111431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=33761a9d3a674837be36ae61b1c103be, user.id=670c00ad0c5849ad8817c6c44d712eac) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:12:40.111745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:12:40.113186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebca58-f450-45fd-9480-3651f5f63c86 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:12:40.116043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:40.119492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 597/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:12:39 2022] GET /identity/v3/role_assignments?user.id=670c00ad0c5849ad8817c6c44d712eac&scope.project.id=33761a9d3a674837be36ae61b1c103be&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:12:49.983204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=14 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:55.950932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab005-3fb5-49cd-a38d-68f1874b7410 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:55.952155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab005-3fb5-49cd-a38d-68f1874b7410 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:55.952155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab005-3fb5-49cd-a38d-68f1874b7410 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:55.953466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 604/1201] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:13:55.958841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:55.959257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:55.959417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:55.978318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:55.988602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:56.050372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 598/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:13:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:13:56.075262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab005-3fb5-49cd-a38d-68f1874b7410 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:56.180031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab005-3fb5-49cd-a38d-68f1874b7410 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:56.214360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:56.215161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:56.215449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:56.215729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:56.226314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:56.229176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:13:56.246102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:13:56.247312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:13:56.248928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:13:56.248928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:13:56.248928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:13:56.248928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:13:56.248928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 605/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:13:56.253868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:56.352605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fd277-32d6-4a36-9cf2-c87b955c2528 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:56.382006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:56.387665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:56.388328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:56.388615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:56.388895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:56.389614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:13:56.389924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:56.391465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd053d17-ad42-4f8c-93a3-a5e86e6beaa4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:56.402673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 599/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:13:56.408605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:56.461792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:56.508882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32b183-0869-4780-b526-50488e1ec66e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:56.543180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:56.543858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:56.544142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:56.544423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:56.545751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:56.547254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a027-3d18-4c46-9ddb-62cd0c5ebe47 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:56.630753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 606/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Jul 4 09:13:56 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:13:58.719436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97128-c42a-4550-bfd9-ee270e9aff01 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:58.720064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97128-c42a-4550-bfd9-ee270e9aff01 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:58.720064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97128-c42a-4550-bfd9-ee270e9aff01 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:58.721479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 600/1206] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:13:58.726535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:58.726930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:58.727188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:58.744729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:13:58.745911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:13:58.812825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 607/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:13:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:13:58.838575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f97128-c42a-4550-bfd9-ee270e9aff01 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:58.943089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f97128-c42a-4550-bfd9-ee270e9aff01 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:58.976772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:58.977495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:58.977779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:58.978054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:58.989346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:13:58.997847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:13:58.999084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:13:59.000089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 601/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:13:59.004667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.044132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:59.104487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a336-b330-4a28-a39f-fe21d1572168 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.139253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.139926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.140230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.140510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.141258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:13:59.141609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:59.143148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:59.151490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 608/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:13:59.157852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.208012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:59.257531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f418e2-41f1-46e3-8da4-b7377850f162 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.292266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.293191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.293476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.293851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.305233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:59.306719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:13:59.324331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:13:59.325468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:13:59.327123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:13:59.327123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:13:59.327123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:13:59.327123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:13:59.327123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 602/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:13:59.332352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.431826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:59.434943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44028-5edf-49f4-a9ff-b3bf34b7d29e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.469430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.470095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.470415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.470696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.471424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:13:59.471733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:59.473106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:59.484557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 609/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:13:59.490056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.588984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8ad3-4e98-4ac2-9c23-5e28a33c3625 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.590552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:59.622394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.623711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.623993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.624268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.631986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:59.635233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:13:59.650070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:13:59.651259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:13:59.652533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 603/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:13:59.657215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.757117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aace2-f73b-4db4-bc43-a577794bbc49 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.790142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.790847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.791142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.791420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.792259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:13:59.792567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:13:59.793997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:13:59.811839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 610/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:13:59.817881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:13:59.915333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f79a-d049-4f7e-b67a-de43d9a50dbe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:13:59.951796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:13:59.952440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:13:59.952723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:13:59.952994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:13:59.983384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.021312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.022753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.127997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 604/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:13:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:14:00.133854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:00.152575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.235098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cde1-a459-4ef9-88d2-d917d3989e7a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:00.269821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:00.272057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:00.272057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:00.272057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:00.282456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.283955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:00.301849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:00.303010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:00.304364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:00.304364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:00.304364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:00.304364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:00.304364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 611/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:00.308947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:00.370705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.408741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85a18-b740-4887-b81c-5603d9fb6817 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:00.441476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:00.442218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:00.442544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:00.442827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:00.443590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:00.443944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.445456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.457951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 605/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:00.463749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:00.534362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.564274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfef31-6076-4410-8c10-0ffd60694681 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:00.598019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:00.598842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:00.599126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:00.599401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:00.606249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.607751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:00.622545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:00.623706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:00.624733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 612/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:00.629709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:00.732860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422e70-8c9a-4852-99ff-b3dca1a39ea9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:00.756085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.767382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:00.768042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:00.768330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:00.768610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:00.769404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:00.769716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.771194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fb14a-cbc7-49d8-824c-633c6c99ddd5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.783282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 606/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:00.805752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:00.889781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ecf7e-05a6-4e5c-b754-e53fb78efa4c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:00.917230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:00.925831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:00.926521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:00.926804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:00.927077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:00.927972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7edebd2d5e7048639b43be8ae5288a38) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:00.928281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:00.929708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a85e-c175-4a2e-a042-20976c7bb296 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:00.940763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 613/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:14:00 2022] GET /identity/v3/role_assignments?user.id=7edebd2d5e7048639b43be8ae5288a38&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:02.959704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c87-2161-4f72-b5e2-15af51d22911 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:02.960303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c87-2161-4f72-b5e2-15af51d22911 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:02.960303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c87-2161-4f72-b5e2-15af51d22911 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:02.961629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 607/1220] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:02.966859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:02.967349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:02.967454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:02.986133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:02.987379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:03.054708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 614/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:03.077944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c132c87-2161-4f72-b5e2-15af51d22911 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.187527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c132c87-2161-4f72-b5e2-15af51d22911 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:03.222987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:03.223699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:03.223983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:03.224304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:03.236229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:14:03.244278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:03.245350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:03.246288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 608/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:03.253233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.352056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a816-e928-4abf-8210-245e21afbfa1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:03.375925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:03.386272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:03.387704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:03.387704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:03.387704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:03.388298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:03.388611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:03.390020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:03.398089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 615/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:03.404699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.450713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:03.507900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da278-4c7d-412b-8c86-568cbc30e73e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:03.540550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:03.545480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:03.545480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:03.545480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:03.553638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:03.555233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:03.573317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:03.574504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:03.575518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:03.575518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:03.575518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:03.575518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:03.575518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 609/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:03.580625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.682099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa586d-b4e7-4176-b71a-891dfe11d289 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:03.714833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:03.715493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:03.715776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:03.716053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:03.718469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:03.718469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:03.723052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:03.730787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 616/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:03.736897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.836470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:03.842845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a47c-d31c-48a2-83a0-5a7849d777b2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:03.879750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:03.880725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:03.881055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:03.881377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:03.888947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:03.890432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:14:03.905525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:03.913059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:03.914267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 610/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:03.915001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:03.961701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:04.014927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d323b-97b0-451c-8f8e-586eba5f327d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.048666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.049334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.049617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.049898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.050743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:04.051052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.052557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:04.069035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 617/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:14:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:04.074807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:04.174494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ea1-1d6b-4aec-bb6d-310adc294eab None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.208919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.209719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.210003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.210312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.221041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.223846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:04.240537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:04.241995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:04.242969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:04.242969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:04.242969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:04.242969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:04.242969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 611/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:04.247763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:04.347961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa26df-c4c0-498f-ba4d-2d607a97461c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.350350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:04.381790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.382531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.382900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.383212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.384078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:04.384395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.385821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:04.397913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 618/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:04.403591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:04.413008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:04.503377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d7f54-a25e-4b2f-a9d5-8e357746c374 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.539331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.539562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.539786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.540070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.546786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.548236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:04.563075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:04.564108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:04.565161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 612/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:04.570402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:04.674687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ab1a-a75a-41ad-acee-dd094f769410 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.708577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.709235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.709523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.709829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.710616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:04.710930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.712360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45542aa-71a6-405c-9594-830728f769c6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:04.724445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 619/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:04.730494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:04.798555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:04.838633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1ddb-7384-4dd1-98dd-68aa3d7d87ba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:04.875765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:04.876660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:04.876948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:04.877230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/7edebd2d5e7048639b43be8ae5288a38/roles/99712536636b49298bfaa1d9f3df6932` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:04.892302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=7edebd2d5e7048639b43be8ae5288a38, role_id=99712536636b49298bfaa1d9f3df6932)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:04.893801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe0500-a58e-4b4f-966a-9f0ab3a9bd2c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:05.106471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 613/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:14:04 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/7edebd2d5e7048639b43be8ae5288a38/roles/99712536636b49298bfaa1d9f3df6932 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:14:07.131260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd401-3b88-48b8-b01b-51efaaf387f1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.131818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd401-3b88-48b8-b01b-51efaaf387f1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.131818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd401-3b88-48b8-b01b-51efaaf387f1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.133173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 620/1233] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:07.138413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.138868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.138974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.156932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:07.162871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:07.225054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 614/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:07.250290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd401-3b88-48b8-b01b-51efaaf387f1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:07.275856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:07.352752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd401-3b88-48b8-b01b-51efaaf387f1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:07.387267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:07.388000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.388290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.388576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.399937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:14:07.408336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:07.409517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:07.410493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 621/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Jul 4 09:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:07.415606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:07.461795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:07.513946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278814d3-8b2e-4d53-938e-ff923553b20e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:07.548334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:07.549007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.549297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.549579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.550427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:07.550740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:07.557489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:07.560262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 615/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Jul 4 09:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:07.566183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:07.657147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:07.673314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe204e-c4a3-4e81-a213-fee85638492a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:07.707561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:07.708416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.708701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.708977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.719696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:07.721325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:07.738553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:07.739813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:07.740729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:07.740729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:07.740729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:07.740729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:07.740729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 622/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:14:07.746088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:07.846553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f2e1-9e9e-4485-bc92-a3f436d7a524 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:07.856822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:07.881703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:07.882510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:07.882675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:07.882947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:07.883658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:07.883964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:07.885326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:07.897645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 616/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:14:07.903536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.004034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163269a4-8bbd-4b1b-b628-f8a0093a9292 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:08.038784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:08.039754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:08.039898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:08.040146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:08.042958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:08.049199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:08.050675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:14:08.065474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:08.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:08.067916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 623/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:08.072651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.174020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582edc-7d23-43e2-9ee0-1dd1bd9e2e83 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:08.208324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:08.209005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:08.209292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:08.209575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:08.210498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:08.210853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:08.212352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:08.230134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 617/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:14:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:14:08.236378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.337759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071c66-8be0-4c72-b6f2-a108298fc9cd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:08.370557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:08.371191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:08.371472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:08.371743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:08.431495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:08.438574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:08.440019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:08.538139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 624/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:14:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:14:08.544004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.571371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:08.645554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b7c49-4c52-4d7a-b3e1-d40e5ac9742f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:08.680148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:08.680996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:08.681285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:08.681566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:08.692380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:08.693857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:08.713527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:08.721462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:08.722628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:08.722628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:08.722628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:08.722628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:08.722628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 618/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:08.722992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.813038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:08.818616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb6b8-d1c9-4019-a62c-30faac40e9b1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:08.851034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:08.851687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:08.851971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:08.852249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:08.853010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:08.853319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:08.854743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:08.866734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 625/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:08.872657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:08.950476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:08.971430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22a54c-9f74-49a6-9090-7d46ac27117c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:09.006222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:09.007044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:09.007324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:09.007601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:09.014670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:09.016122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:09.029794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:09.030977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:09.032092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 619/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:09.037014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:09.141057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacfb7b-04f8-4bd6-a77b-4aee12868571 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:09.175558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:09.176228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:09.176555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:09.176826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:09.177646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:09.177982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:09.179486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd7b5-b152-44f4-a86f-3f6165dbefd9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:09.192175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 626/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:09.198369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:09.300497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c88dc-aa32-4b79-9e0d-332059983d00 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:09.333289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:09.334051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:09.334366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:09.334640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:09.335463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] RBAC: Adding query filter params (role.id=99712536636b49298bfaa1d9f3df6932, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7edebd2d5e7048639b43be8ae5288a38) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:09.335771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:09.337186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3efe-9518-44d9-8e48-edf633c94171 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:09.343470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 620/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:14:09 2022] GET /identity/v3/role_assignments?user.id=7edebd2d5e7048639b43be8ae5288a38&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=99712536636b49298bfaa1d9f3df6932 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:11.444615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0ad-e1a0-4236-b2db-e53c6a1d810d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:11.445182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0ad-e1a0-4236-b2db-e53c6a1d810d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:11.445182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0ad-e1a0-4236-b2db-e53c6a1d810d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:11.446816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 627/1247] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:11.452438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:11.452855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:11.453018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:11.458122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:11.470123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:11.471326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:11.535983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 621/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:11.561928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a0ad-e1a0-4236-b2db-e53c6a1d810d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:11.580409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:11.664057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a0ad-e1a0-4236-b2db-e53c6a1d810d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:11.696946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:11.697783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:11.698069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:11.698378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:11.708907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:14:11.716555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:11.717693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:11.718668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 628/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:11.723969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:11.822865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75299-ccc3-4e81-b53a-9dbbe664bea6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:11.852380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:11.857113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:11.858402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:11.858692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:11.858973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:11.859725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:11.860037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:11.861410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:11.869978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 622/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:11.876400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:11.955295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:11.978070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b85d1-d29f-4223-91ee-21a1330cd47d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.012292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.013085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.013372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.013692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:12.024088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:12.025537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:12.042499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:12.043628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:12.044614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:12.044614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:12.044614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:12.044614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:12.044614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 629/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:12.050707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:12.153500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092efffa-0946-4260-be6d-d7f3ee7348d4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.188034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.188695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.188981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.189260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:12.189987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:12.190366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:12.191809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:12.211538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 623/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:12.217708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:12.318841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e199-7676-406f-a4ef-759178c57f38 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.344818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:12.353323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.354131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.354453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.354736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:12.363218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:12.364696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:14:12.379476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:12.380606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:12.381606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 630/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:12.386598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:12.442562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:12.488549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2889-f66f-437d-b095-927ec31a5d0b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.523567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.524515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.524930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.525309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:12.526139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:12.526489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:12.527904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:12.548924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 624/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:14:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:12.554889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:12.655477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677cd9-8ebf-4578-a98e-b7e4eb90349a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.688414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.689065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.689356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.689640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:12.745356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:12.757708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:12.759204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:12.858002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 631/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:14:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:14:12.863869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:12.963986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef6c7-e59a-45df-a15c-4347cc3efa14 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:12.977190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:12.997386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:12.998728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:12.999010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:12.999283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:13.009224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:13.010689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:13.028836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:13.038548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:13.039464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:13.039464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:13.039464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:13.039464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:13.039464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 625/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:13.039752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:13.125183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:13.138684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4f9ce-4f0c-4d99-a07d-d23a37e77e9d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:13.172175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:13.172835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:13.173119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:13.173400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:13.174123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:13.174460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:13.175832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:13.187498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 632/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:13.193282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:13.294072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7a727-1226-4d77-bee0-ec5a450b7bff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:13.327926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:13.328712 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:13.328998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:13.329277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:13.335851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:13.337304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:13.350834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:13.351905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:13.353113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 626/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:13.358391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:13.459191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6793ec-c7e1-4383-851d-186e48c0c4ab None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:13.491923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:13.492569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:13.492849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:13.493123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:13.493892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:13.494225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:13.495652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deeee4-75f8-4a24-8c48-60040d4655cf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:13.508753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 633/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:13.515011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:13.540880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:13.614412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c216-3953-4bc5-850b-341aa9684c01 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:13.649372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:13.650028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:13.650348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:13.650628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:13.651455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7edebd2d5e7048639b43be8ae5288a38) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:13.651773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:13.653212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a921bf-0311-4956-8b11-207e182af41c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:13.659238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 627/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:14:13 2022] GET /identity/v3/role_assignments?user.id=7edebd2d5e7048639b43be8ae5288a38&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:15.680669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ab5d-7983-4bc4-a63e-ecf62df16168 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:15.681184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ab5d-7983-4bc4-a63e-ecf62df16168 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:15.681184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ab5d-7983-4bc4-a63e-ecf62df16168 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:15.682585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 634/1261] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:15.687684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:15.688825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:15.688825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:15.705606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:15.706833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:15.773815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 628/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:15.797205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ab5d-7983-4bc4-a63e-ecf62df16168 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:15.808370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:15.898521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ab5d-7983-4bc4-a63e-ecf62df16168 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:15.933455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:15.934172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:15.934489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:15.934768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:15.945142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:14:15.953305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:15.955657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:15.956749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 635/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:15.961014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:15.979574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:16.060021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f22d-fe6c-474b-a286-97ed86401687 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.095353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.096020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.096310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.096593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.097383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:16.097697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.099122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.107618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 629/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:16.113570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:16.181539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:16.218574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1de3-0bc1-41de-9d8e-f1cb3e6f35ca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.253613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.254438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.254729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.255010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.266091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.267578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:16.284682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:16.285747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:16.287055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:16.287055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:16.287055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:16.287055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:16.287055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 636/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:16.291868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:16.374518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:16.393291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60ebcb-6d62-4822-965e-a45a0a5f0dde None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.427214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.427868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.428152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.428429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.429230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:16.429538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.430926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.442474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 630/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:16.448337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:16.548928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47bf5-8fcd-44e1-b765-7a868630d811 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.568822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:16.582597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.583585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.583909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.599605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.599605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.599605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:14:16.608421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:16.609650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:16.611016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 637/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:16.615597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:16.720567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49299-54d6-4c11-a003-09e2965ac906 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.754568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.755235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.755521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.755797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.756658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:16.756968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.758425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.768078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:16.776271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 631/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:16.782556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:16.883441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d240e-1e29-4462-9081-1453b0eb73fe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:16.916360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:16.917154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:16.917434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:16.917702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:16.928681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:16.930120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:16.946814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:16.947870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:16.949180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:16.949180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:16.949180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:16.949180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:16.949180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 638/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:16.953863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:17.053025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427fde-bc92-4531-9085-d49e254794e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:17.088319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:17.088981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:17.089263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:17.089536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:17.090272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:17.090580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:17.092087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:17.103378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 632/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:17.109472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:17.140890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:17.213280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902045f-f7d8-44ec-9f67-0c32ba6affe6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:17.247107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:17.247932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:17.248222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:17.248501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:17.255018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:17.256465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:17.271046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:17.272150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:17.273277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 639/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:17.278364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:17.337278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:17.380215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16626-71c2-4190-8a9c-a3d3e5667919 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:17.414323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:17.414889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:17.415170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:17.415449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:17.416386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:17.416580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:17.418056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9342d1c-6348-4968-bef4-248c044ed05b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:17.429953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 633/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:17.436618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:17.530044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:17.538557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dd6c-d64d-4459-9707-bf03d3f522f4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:17.571799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:17.572682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:17.572966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:17.573245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] PATH_INFO: `/v3/projects/c5f791abde63489fbc08437683a0b314/users/7edebd2d5e7048639b43be8ae5288a38/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:17.575245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f791abde63489fbc08437683a0b314, user_id=7edebd2d5e7048639b43be8ae5288a38, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:17.577345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40834b0-5866-487a-84f3-23873e1f1c2f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:17.687784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 640/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Jul 4 09:14:17 2022] PUT /identity/v3/projects/c5f791abde63489fbc08437683a0b314/users/7edebd2d5e7048639b43be8ae5288a38/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:14:19.723784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b33e3-5b97-4b2f-aa88-cb5896f4dfbb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:19.724308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b33e3-5b97-4b2f-aa88-cb5896f4dfbb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:19.724428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b33e3-5b97-4b2f-aa88-cb5896f4dfbb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:19.725742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 634/1274] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:19.731031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:19.733491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:19.733491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:19.748722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:19.749948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:19.816550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 641/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:19.840502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b33e3-5b97-4b2f-aa88-cb5896f4dfbb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:19.942263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b33e3-5b97-4b2f-aa88-cb5896f4dfbb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:19.959768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:19.975999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:19.976771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:19.977060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:19.977380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:19.987372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:14:19.995414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:19.996527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:19.997435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 635/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Jul 4 09:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:20.003375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.084782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:20.102272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476c39-c5b9-4882-a549-b583a8eddeff None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.136491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.137163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.137450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.137734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:20.138541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:20.138854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:20.140294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:20.148454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 642/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:20.154265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.259342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fea0d-e3b3-484d-beae-92ed3b17dbbc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.292784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.293551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.293835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.294109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:20.304514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:20.305952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:20.322764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:20.323824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:20.324768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:20.324768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:20.324768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:20.324768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:20.324768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 636/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:20.330521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.430329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97101f-89b1-4e5b-b4dd-a6c54c1bc834 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.464973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.465637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.465922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.466326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:20.467070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:20.467381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:20.468766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:20.480582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 643/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:20.486545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.518504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:20.588802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f94b-bfc0-48e4-85c0-530259276066 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.622996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.623808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.624092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.624372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:20.632221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:20.633679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:14:20.649624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:20.650820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:20.652281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 637/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:20.656879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.660918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:20.754478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0007-fc81-4b3b-9581-97bddc12788d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.789059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.789841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.790157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.790472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:20.791350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:20.795778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:20.795778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:20.811819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 644/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:20.817640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:20.908832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:20.918239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8a78-7560-46a7-91ac-352b7262cca0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:20.953724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:20.954397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:20.954681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:20.954957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.020693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.022099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.112681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:21.123983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 638/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Jul 4 09:14:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:14:21.129895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:21.193527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:21.233004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343573-6ffa-475a-b7c3-6e4d9037007f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:21.266859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:21.269176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:21.269176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:21.269176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.278458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.280413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:14:21.298243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:21.304905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:21.306053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:14:21.306053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:14:21.306053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:14:21.306053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:21.306053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 645/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:21.306460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:21.403548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca2ad0-28b1-4d0e-bec3-b76a99a91f61 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:21.438348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:21.439004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:21.439289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:21.439564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.440282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:21.440587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.441946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.453122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 639/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Jul 4 09:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:21.458848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:21.558276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df12f45-8fd6-4c29-ba54-15280288dfab None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:21.571985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:21.592267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:21.593058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:21.593343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:21.593621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.601218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.602698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:14:21.616904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:21.618066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Jul 04 09:14:21.619523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 646/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Jul 4 09:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:14:21.624226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:21.676371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:21.725713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902047-3dca-4968-9afc-e62ba1c94c8a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:21.758271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:21.758934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:21.759219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:21.759492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.760262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:21.760569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.762067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03291-c57f-45a9-9a6f-930e11707655 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.774550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 640/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Jul 4 09:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:21.781363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:21.879487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e59f2-1485-4bef-b90a-aa40b3ab1d05 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:21.913444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:21.914097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:21.914538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:21.914816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:21.915640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] RBAC: Adding query filter params (role.id=a37517ecfb38458e8399e44c1ab88230, scope.project.id=c5f791abde63489fbc08437683a0b314, user.id=7edebd2d5e7048639b43be8ae5288a38) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:21.915952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:21.917446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9bfd9-cb75-4944-bfc2-ba2d8e9baef8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:21.923690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 647/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Jul 4 09:14:21 2022] GET /identity/v3/role_assignments?user.id=7edebd2d5e7048639b43be8ae5288a38&scope.project.id=c5f791abde63489fbc08437683a0b314&role.id=a37517ecfb38458e8399e44c1ab88230 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:23.997729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a66b2-552f-461c-bb07-f19ac4b684de None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:23.998286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a66b2-552f-461c-bb07-f19ac4b684de None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:23.998412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a66b2-552f-461c-bb07-f19ac4b684de None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:23.999770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 641/1288] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:24.004807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:24.005232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:24.005369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:24.023236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:24.024437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:24.054791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:24.092517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 648/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:14:24.115166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a66b2-552f-461c-bb07-f19ac4b684de None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:24.219678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a66b2-552f-461c-bb07-f19ac4b684de None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:24.230942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:24.261146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:24.261146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:24.261146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:24.261146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:24.261636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:24.261636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:24.270766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:24.272056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:24.273285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 642/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:14:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:24.278097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:24.375555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a04b4-20ac-4aee-8016-9f112db8c4cb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:24.408601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:24.409261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:24.409543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:24.409820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:24.410550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:24.410859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:24.412256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcdfd-35d1-490d-b4e1-cb633dace817 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:24.417043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 649/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Jul 4 09:14:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:24.422980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:24.525060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f130cf-0684-4080-b16d-d37a183ec68f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:24.558451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:24.561595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:24.561595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:24.561595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:24.561595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:24.561595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:24.562713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003af8f-87ee-45ab-bb2a-b697240fca50 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:24.567160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 643/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Jul 4 09:14:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:26.607556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f75ab-8be2-401f-b40a-4aebdd7fb3ca None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:26.608079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f75ab-8be2-401f-b40a-4aebdd7fb3ca None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:26.608079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f75ab-8be2-401f-b40a-4aebdd7fb3ca None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:26.609404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 650/1293] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:26.614452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afd-21c9-40b6-af19-2ba3d7d0cba1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:26.614829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afd-21c9-40b6-af19-2ba3d7d0cba1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:26.615027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afd-21c9-40b6-af19-2ba3d7d0cba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:26.632434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10d06afd-21c9-40b6-af19-2ba3d7d0cba1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:26.633625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10d06afd-21c9-40b6-af19-2ba3d7d0cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:26.664342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:26.700650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 644/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:26.723825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f75ab-8be2-401f-b40a-4aebdd7fb3ca None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:26.756127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:26.827080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f75ab-8be2-401f-b40a-4aebdd7fb3ca None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:26.861666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:26.862381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:26.862672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:26.862976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:26.863711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:26.865119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1f40a-db3e-43fc-9490-f295dc598c80 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:27.021462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 651/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Jul 4 09:14:26 2022] POST /identity/v3/services => generated 246 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:14:29.066517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6fc0-a86c-433b-b4c5-5eb30ae8721f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.067138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6fc0-a86c-433b-b4c5-5eb30ae8721f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.067138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6fc0-a86c-433b-b4c5-5eb30ae8721f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.068645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 645/1296] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:29.074679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.075723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.075904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.093440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:29.109490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:29.168830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 652/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:29.192173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6fc0-a86c-433b-b4c5-5eb30ae8721f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:29.300228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6fc0-a86c-433b-b4c5-5eb30ae8721f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:29.335233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:29.335958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.336244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.336523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.337219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:29.338627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:29.351419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:29.352714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:29.353631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 646/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:14:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:29.358846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:29.377842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:29.466874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ecb3-de25-4e9c-8cc4-ca42e29f00e7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:29.506783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:29.507479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.507777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.508060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.508837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:29.509156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:29.510719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:29.522867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 653/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Jul 4 09:14:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:29.524141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:29.559769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:29.637169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869f5d8-1f39-45d4-8485-0346f1bd7c78 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:29.676073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:29.676748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.677028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.677303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.678154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] RBAC: Adding query filter params (interface=public, service_id=74aaf80c446e484e93d2188915ee08fd, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:29.678501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:29.679963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5947f8-74db-414e-ae3f-3398afe0c324 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:29.686490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 647/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Jul 4 09:14:29 2022] GET /identity/v3/endpoints?service_id=74aaf80c446e484e93d2188915ee08fd&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:29.692299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:29.782778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:29.802126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7260-715c-4d9d-a583-2aa71414eca3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:29.838977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:29.839650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:29.839938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:29.840216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:29.840944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:29.842360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727e7d9-8ed3-452d-8fc4-67c18e41a5e4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:29.849402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 654/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Jul 4 09:14:29 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:14:31.886557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f1ea-133e-4c59-a348-2222e68f67ce None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:31.887137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f1ea-133e-4c59-a348-2222e68f67ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:31.887137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f1ea-133e-4c59-a348-2222e68f67ce None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:31.889052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 648/1302] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:14:31.894562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:31.898062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:31.898062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:31.911732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:14:31.912923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:14:31.983342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 655/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:14:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:14:32.009325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65f1ea-133e-4c59-a348-2222e68f67ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:32.104918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:32.112278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65f1ea-133e-4c59-a348-2222e68f67ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:32.146892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:32.147616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:32.147904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:32.148222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:32.148857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:32.150258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:14:32.162701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:14:32.163908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 04 09:14:32.164772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 649/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Jul 4 09:14:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:14:32.170716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:32.249283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:32.271726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007f625-9e9a-4fa5-8796-8e01b5cafdeb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:32.305197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:32.305876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:32.306165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:32.306481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:32.307198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:14:32.307554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:32.308929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b310a9-1525-4ed1-bff2-6aab3b183e0e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:32.314943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 656/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Jul 4 09:14:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:14:32.321187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:14:32.423449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29977ea4-8f59-44c1-bc1e-b01178696749 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:14:32.457976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:14:32.458665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:14:32.458957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:14:32.459241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:14:32.460011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:14:32.461396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226637-8f82-40c3-afb2-b88ffc8cafba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:14:32.670567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 650/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Jul 4 09:14:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:14:42.321416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=30 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:42.665735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:43.770808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8f2e-655a-462d-b8a6-5f17c600bd81 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:43.771258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8f2e-655a-462d-b8a6-5f17c600bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:43.771561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8f2e-655a-462d-b8a6-5f17c600bd81 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:43.773302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 657/1307] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:22:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:43.778816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfc05-7b62-4b20-a0bf-120dbd5417ee None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:43.779229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfc05-7b62-4b20-a0bf-120dbd5417ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:43.779603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfc05-7b62-4b20-a0bf-120dbd5417ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:43.875623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-abfdfc05-7b62-4b20-a0bf-120dbd5417ee None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:43.877874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-abfdfc05-7b62-4b20-a0bf-120dbd5417ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:44.023018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 651/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:44.073260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:44.073545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:44.073839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:44.075342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 658/1309] 10.222.0.61 () {54 vars in 964 bytes} [Mon Jul 4 09:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:44.087240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7daa0-eb84-4ff7-bb8e-118b66a2aad6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:44.088645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7daa0-eb84-4ff7-bb8e-118b66a2aad6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:44.089803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7daa0-eb84-4ff7-bb8e-118b66a2aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:44.184181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e8c7daa0-eb84-4ff7-bb8e-118b66a2aad6 None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:44.185550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e8c7daa0-eb84-4ff7-bb8e-118b66a2aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:44.213577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:44.275582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 652/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Mon Jul 4 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:44.284715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:44.286541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:44.403619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53d18-c7af-42fe-b1b3-ce426f0d640c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:44.489355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:44.490181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:44.490561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:44.490913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:44.492664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:44.552770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:44.610960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:44.612954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a88f7-e8c3-4d34-b85a-93a811794e0b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:44.636176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 659/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:46.988967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d77-2acb-4b8a-ac59-55d04215f817 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:46.989512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d77-2acb-4b8a-ac59-55d04215f817 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:46.989512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d77-2acb-4b8a-ac59-55d04215f817 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:46.993666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 653/1312] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:22:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:46.996353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939354-1863-4cc0-b1b7-d825db4405cc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:46.996789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939354-1863-4cc0-b1b7-d825db4405cc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:46.996985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49939354-1863-4cc0-b1b7-d825db4405cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:47.073492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-49939354-1863-4cc0-b1b7-d825db4405cc None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:47.074926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49939354-1863-4cc0-b1b7-d825db4405cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:47.197566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 660/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:47.254031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:47.254369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:47.254874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:47.256317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 654/1314] 10.222.0.61 () {54 vars in 964 bytes} [Mon Jul 4 09:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:47.263422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422a24-2f8d-4aef-805b-c52434dae75e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:47.263648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422a24-2f8d-4aef-805b-c52434dae75e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:47.263904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422a24-2f8d-4aef-805b-c52434dae75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:47.276286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:47.350850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0d422a24-2f8d-4aef-805b-c52434dae75e None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:47.352220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0d422a24-2f8d-4aef-805b-c52434dae75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:47.435465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 661/1315] 10.222.0.61 () {58 vars in 1061 bytes} [Mon Jul 4 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:47.444366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:47.446042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:47.573675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb228d8c-4717-42ec-9c7f-cfda37a2a4b3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:47.645686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:47.648359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:47.649022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:47.649312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:47.649596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:47.651312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:47.763050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:47.764433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ec919-d263-423e-ba59-c203684ba0d8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:47.783051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 655/1316] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:50.581144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:50.581656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:50.581656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:50.583054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 662/1317] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:50.588396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828ed3-67d0-493e-84e5-11f9cb469da5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:50.588802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828ed3-67d0-493e-84e5-11f9cb469da5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:50.588962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828ed3-67d0-493e-84e5-11f9cb469da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:50.655094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d2828ed3-67d0-493e-84e5-11f9cb469da5 None None] MFA Rules not processed for user `e0e490f204044da49e3dfa0e62de8224`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:50.656406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d2828ed3-67d0-493e-84e5-11f9cb469da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:50.708960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:50.753995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 656/1318] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:22:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:50.792794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:50.794342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:50.899573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7339a-62ab-4fec-9d1c-7949a873ee12 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:50.902322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:50.976581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:50.977226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:50.977511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:50.977790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:50.979466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:51.087182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:51.088642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc45cb-d23f-448d-a8cc-bf753e68ec4e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:51.106840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 663/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:53.959649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:53.960217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:53.960217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:53.961612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 657/1320] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:53.966929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea79-3f8e-43cb-a962-4b31849985ac None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:53.967316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea79-3f8e-43cb-a962-4b31849985ac None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:53.967485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea79-3f8e-43cb-a962-4b31849985ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:54.008130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:54.032431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-44d1ea79-3f8e-43cb-a962-4b31849985ac None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:54.033663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-44d1ea79-3f8e-43cb-a962-4b31849985ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:54.130023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 664/1321] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:22:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:54.170756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:54.172319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:54.276827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4756f-e99f-441e-8413-fa7c8622b5f7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:54.353788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:54.354457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:54.354743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:54.355025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:54.356731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:54.364914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:54.473082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:54.474573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138dad3-8e57-4a14-b80d-dff2f6085447 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:54.493238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 658/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:22:57.886692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.887201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.887201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.888556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 665/1323] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:22:57.894470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1acd-cc79-4999-b97f-ccb1c4905919 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:57.894904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1acd-cc79-4999-b97f-ccb1c4905919 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:57.895028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1acd-cc79-4999-b97f-ccb1c4905919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:57.961284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-779a1acd-cc79-4999-b97f-ccb1c4905919 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:22:57.962642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-779a1acd-cc79-4999-b97f-ccb1c4905919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:58.020503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:58.060823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 659/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:22:58.098655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:22:58.100193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:58.215557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682df51-d9da-4baa-945d-d3d08e48b8b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:22:58.231328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:58.300719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:22:58.301382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:22:58.301668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:22:58.301950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:22:58.303716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:22:58.419943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:22:58.421389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f954-1b58-4afd-ae42-c597ffcdf402 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:22:58.440475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 666/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:00.558459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:00.558967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:00.558967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:00.560375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 660/1326] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:00.566157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37703d4-6714-4016-8bc3-6af4e157090d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:00.566618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37703d4-6714-4016-8bc3-6af4e157090d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:00.566823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37703d4-6714-4016-8bc3-6af4e157090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:00.615973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:00.636242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a37703d4-6714-4016-8bc3-6af4e157090d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:00.636242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a37703d4-6714-4016-8bc3-6af4e157090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:00.738637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 667/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:00.774163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:00.775743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:00.883915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc46a-1d26-42c2-a038-5737c0dec027 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:00.962500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:00.963611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:00.964118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:00.964585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:00.967466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:00.987883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:01.092862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:01.094351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e956e71-8283-458c-ad41-588ec565c2a1 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:01.113428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 661/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:03.231656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.232144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.232260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.233633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 668/1329] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:03.240245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376720-01a9-4e81-b878-e6b35f7be92b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.254539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376720-01a9-4e81-b878-e6b35f7be92b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.254539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376720-01a9-4e81-b878-e6b35f7be92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.308859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-93376720-01a9-4e81-b878-e6b35f7be92b None None] MFA Rules not processed for user `e0e490f204044da49e3dfa0e62de8224`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:03.310059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-93376720-01a9-4e81-b878-e6b35f7be92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.375605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:03.410264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 662/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:03.452819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:03.454442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.567313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407264-dc3e-41ae-acf9-9407853be39f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:03.587435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:03.640963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:03.642302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:03.642603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:03.642904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:03.644569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:03.756961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:03.758449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec618b6-2344-490f-873b-1a4862311d18 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:03.777540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 669/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:06.678346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:06.678881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:06.679004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:06.680761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 663/1332] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:06.686423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49a65-2010-4307-96da-0f73ec7e146b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:06.686897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49a65-2010-4307-96da-0f73ec7e146b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:06.687007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49a65-2010-4307-96da-0f73ec7e146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:06.749825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:06.753152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-74a49a65-2010-4307-96da-0f73ec7e146b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:06.756440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-74a49a65-2010-4307-96da-0f73ec7e146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:06.851118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 670/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:06.886940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:06.888536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:06.991786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41b41-cfb0-4052-ba9c-e50468f5e474 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:07.064513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:07.065163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:07.065452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:07.065761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:07.067560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:07.095557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:07.178206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:07.179678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b001-def4-43f3-b74d-b7ffdd5c5003 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:07.200059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 664/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:09.287901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:09.288427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:09.288550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:09.289866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 671/1335] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:09.294995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc931f4-8101-486c-b871-b13847ac618e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:09.295417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc931f4-8101-486c-b871-b13847ac618e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:09.295566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc931f4-8101-486c-b871-b13847ac618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:09.373130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0cc931f4-8101-486c-b871-b13847ac618e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:09.374616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0cc931f4-8101-486c-b871-b13847ac618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:09.448556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:09.471175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 665/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:09.511793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:09.513336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:09.621540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef588-469b-4777-9899-8d8a00c34f58 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:09.651596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:09.696426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:09.697082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:09.697531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:09.698167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:09.699857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:09.808452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:09.809813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c269e-2ae7-4d08-9a9f-88eac03e3859 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:09.828238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 672/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:12.795030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:12.795624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:12.795624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:12.796984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 666/1338] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:12.802648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66de22-5636-43b8-8647-ebf6f98da7bb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:12.803098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66de22-5636-43b8-8647-ebf6f98da7bb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:12.803272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66de22-5636-43b8-8647-ebf6f98da7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:12.868786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dc66de22-5636-43b8-8647-ebf6f98da7bb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:12.870019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dc66de22-5636-43b8-8647-ebf6f98da7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:12.878627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:12.979639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 673/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:13.017149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:13.018909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:13.131823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddab20-a808-43ce-a917-58d9d815edc2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:13.209115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:13.209769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:13.210057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:13.210366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:13.212017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:13.248341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:13.322716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:13.324066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1647ae7-410b-4243-b900-14feb51f1040 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:13.342748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 667/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:17.788522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:17.788522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:17.789252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:17.790174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 674/1341] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:23:17.796006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2464ed-560c-4291-9d14-ba9dd3c35965 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:17.796006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2464ed-560c-4291-9d14-ba9dd3c35965 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:17.796547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2464ed-560c-4291-9d14-ba9dd3c35965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:17.877116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce2464ed-560c-4291-9d14-ba9dd3c35965 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:17.878610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce2464ed-560c-4291-9d14-ba9dd3c35965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:17.984104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:17.997244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 668/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:18.037537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:18.039776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:18.135489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59decb-27fe-434a-8c69-26fcecaf1038 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:18.139265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:18.139918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:18.140200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:18.140477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:18.153393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:18.154885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0760d-c510-4566-a837-2c1657f5284b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:18.165134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 675/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:21.252547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f9d1e-1888-4051-8d75-abe400ffd914 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.253138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f9d1e-1888-4051-8d75-abe400ffd914 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.253138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f9d1e-1888-4051-8d75-abe400ffd914 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.254560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 669/1344] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:21.260744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d549ef-13f5-4845-8903-a4d6310f6057 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.261281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d549ef-13f5-4845-8903-a4d6310f6057 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.261398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d549ef-13f5-4845-8903-a4d6310f6057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.292682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-56d549ef-13f5-4845-8903-a4d6310f6057 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:21.293974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56d549ef-13f5-4845-8903-a4d6310f6057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:21.325977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:21.378049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 676/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:21.416685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f9d1e-1888-4051-8d75-abe400ffd914 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:21.428650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f9d1e-1888-4051-8d75-abe400ffd914 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:21.432472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:21.433125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:21.433411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:21.433794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:21.443586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:21.445030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81875e0f-d00e-4755-9819-980d6d609437 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:21.454941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 670/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:25.679636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2892c4-5093-4214-b6cd-542e7f7ba183 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.680193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2892c4-5093-4214-b6cd-542e7f7ba183 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.680193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2892c4-5093-4214-b6cd-542e7f7ba183 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.681760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 677/1347] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:25.687214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599286-1bb6-4dac-b4bb-94de2acf162c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.687703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599286-1bb6-4dac-b4bb-94de2acf162c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.687804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599286-1bb6-4dac-b4bb-94de2acf162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.707293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-27599286-1bb6-4dac-b4bb-94de2acf162c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:25.708528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27599286-1bb6-4dac-b4bb-94de2acf162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:25.716720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 671/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:25.756879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2892c4-5093-4214-b6cd-542e7f7ba183 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:25.768521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2892c4-5093-4214-b6cd-542e7f7ba183 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:25.772137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:25.772787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:25.773297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:25.773579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:25.784124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:25.785851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615cc51-4419-442e-a182-e0d606feda06 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:25.795826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 678/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:30.892503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5fcf-27e5-45d1-ab31-192f69b460e6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.893055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5fcf-27e5-45d1-ab31-192f69b460e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.893055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5fcf-27e5-45d1-ab31-192f69b460e6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.894958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 672/1350] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:30.900715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca044e0-d09b-4b75-af46-63c7a2d42606 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:30.901688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca044e0-d09b-4b75-af46-63c7a2d42606 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:30.902773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca044e0-d09b-4b75-af46-63c7a2d42606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:30.994944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aca044e0-d09b-4b75-af46-63c7a2d42606 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:30.996498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aca044e0-d09b-4b75-af46-63c7a2d42606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:31.104983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 679/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:35.511935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88a59-4728-4cf8-966f-e9fd82224186 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:35.512459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88a59-4728-4cf8-966f-e9fd82224186 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:35.512459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c88a59-4728-4cf8-966f-e9fd82224186 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:35.514070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 673/1352] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:35.519939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132327a-20a1-4131-8e0a-dc02f0c5f550 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:35.520343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132327a-20a1-4131-8e0a-dc02f0c5f550 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:35.520565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132327a-20a1-4131-8e0a-dc02f0c5f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:35.539788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6132327a-20a1-4131-8e0a-dc02f0c5f550 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:35.541064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6132327a-20a1-4131-8e0a-dc02f0c5f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:35.549983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 680/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:35.701176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=13 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:37.062377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a194-60ed-4d00-93a7-a139c9364943 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.062982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a194-60ed-4d00-93a7-a139c9364943 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.062982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a194-60ed-4d00-93a7-a139c9364943 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.064467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 674/1354] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:37.069501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ce3-6b1e-4f84-a4d0-3d2a05b59189 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:37.069905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ce3-6b1e-4f84-a4d0-3d2a05b59189 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:37.070067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ce3-6b1e-4f84-a4d0-3d2a05b59189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:37.089313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-905a0ce3-6b1e-4f84-a4d0-3d2a05b59189 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:37.090557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-905a0ce3-6b1e-4f84-a4d0-3d2a05b59189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:37.099289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 681/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:40.637588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e727-423a-4353-9c1e-58e2f76ffa08 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.638111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e727-423a-4353-9c1e-58e2f76ffa08 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.638111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e727-423a-4353-9c1e-58e2f76ffa08 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.640327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 675/1356] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:40.647162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343582a1-7da9-49ab-8363-b0a56da2bca3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.648300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343582a1-7da9-49ab-8363-b0a56da2bca3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.648642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343582a1-7da9-49ab-8363-b0a56da2bca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.672058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-343582a1-7da9-49ab-8363-b0a56da2bca3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:40.673664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-343582a1-7da9-49ab-8363-b0a56da2bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:40.684832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 682/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:40.744736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db27d-4c15-4404-baed-dc08f9380b10 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.745319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db27d-4c15-4404-baed-dc08f9380b10 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.745783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db27d-4c15-4404-baed-dc08f9380b10 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.748223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 676/1358] 10.222.0.61 () {54 vars in 961 bytes} [Mon Jul 4 09:23:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:40.757154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deec7d-1a17-47c9-8e7f-a465e7b48812 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.758736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deec7d-1a17-47c9-8e7f-a465e7b48812 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.758736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deec7d-1a17-47c9-8e7f-a465e7b48812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.805241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:40.821103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f6deec7d-1a17-47c9-8e7f-a465e7b48812 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:40.822857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6deec7d-1a17-47c9-8e7f-a465e7b48812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:40.910428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 683/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Jul 4 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:40.919882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db27d-4c15-4404-baed-dc08f9380b10 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:40.936021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db27d-4c15-4404-baed-dc08f9380b10 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:40.943365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:40.944223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:40.944610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:40.944962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:40.955557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:40.957195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988c0c7-c89d-4b3d-8eee-7320aaf2f36d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:40.978618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 677/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:43.240866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204101c-61af-4d0a-93c3-335a08e7f870 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.241477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204101c-61af-4d0a-93c3-335a08e7f870 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.241477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204101c-61af-4d0a-93c3-335a08e7f870 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.242827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 684/1361] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:43.248161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4411d-b00c-47d1-8e2e-869a13f75caa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.248619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4411d-b00c-47d1-8e2e-869a13f75caa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.248727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4411d-b00c-47d1-8e2e-869a13f75caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.270244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4ab4411d-b00c-47d1-8e2e-869a13f75caa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:43.280695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ab4411d-b00c-47d1-8e2e-869a13f75caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:43.282295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 678/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:43.325350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204101c-61af-4d0a-93c3-335a08e7f870 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:43.341920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204101c-61af-4d0a-93c3-335a08e7f870 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:43.348593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:43.349416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:43.349912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:43.350417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:43.360692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:43.362576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33acd50-b80f-497b-b4dd-2fbdce1886b2 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:43.373657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 685/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:45.861388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156553-1539-401f-8699-464e0285c2e2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.861939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156553-1539-401f-8699-464e0285c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.861939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156553-1539-401f-8699-464e0285c2e2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.863360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 679/1364] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:45.868688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c2d6-fb3a-4769-8614-bcccb08c4a6c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.869130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c2d6-fb3a-4769-8614-bcccb08c4a6c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.873771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c2d6-fb3a-4769-8614-bcccb08c4a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.906683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3e29c2d6-fb3a-4769-8614-bcccb08c4a6c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.908259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3e29c2d6-fb3a-4769-8614-bcccb08c4a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:45.917505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 686/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:45.964951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c087a-6333-43cc-b564-522e36f3b313 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.965507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c087a-6333-43cc-b564-522e36f3b313 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.965635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c087a-6333-43cc-b564-522e36f3b313 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.967348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 680/1366] 10.222.0.61 () {54 vars in 961 bytes} [Mon Jul 4 09:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:45.972665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a084-f170-4e43-87d2-d68ddd6994c2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:45.973025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a084-f170-4e43-87d2-d68ddd6994c2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:45.973311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a084-f170-4e43-87d2-d68ddd6994c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:45.991784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bd22a084-f170-4e43-87d2-d68ddd6994c2 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:45.992970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bd22a084-f170-4e43-87d2-d68ddd6994c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:46.003367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 687/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Jul 4 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:23:46.011181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c087a-6333-43cc-b564-522e36f3b313 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:46.025443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c087a-6333-43cc-b564-522e36f3b313 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:46.031551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:46.032190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:46.032479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:46.032767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:46.041025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:46.042636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b172b9a-7759-4229-bb31-3e16788b6bf7 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:46.052880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 681/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:48.381282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83910-4b8a-46b6-9813-b108ba67542a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.381813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83910-4b8a-46b6-9813-b108ba67542a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.381930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83910-4b8a-46b6-9813-b108ba67542a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.383261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 688/1369] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:48.388917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a566-bf15-483d-8e4f-21a4109aaf76 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.389374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a566-bf15-483d-8e4f-21a4109aaf76 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.389513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a566-bf15-483d-8e4f-21a4109aaf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.408573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9a18a566-bf15-483d-8e4f-21a4109aaf76 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:48.409773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9a18a566-bf15-483d-8e4f-21a4109aaf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:48.418149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 682/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:48.463071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83910-4b8a-46b6-9813-b108ba67542a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:48.478067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83910-4b8a-46b6-9813-b108ba67542a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:48.483927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:48.484497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.484776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.485180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.493784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:48.495428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab55841-60ac-475f-8ddc-e3e3ecb3f84f service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:48.506188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 689/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:48.965239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc8ef-7c0b-426e-bd80-23c2868e1f7e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.965594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc8ef-7c0b-426e-bd80-23c2868e1f7e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.965897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc8ef-7c0b-426e-bd80-23c2868e1f7e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.967587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 683/1372] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:23:48.973170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7748f-e39f-4eb7-a439-f1f511070a21 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:48.973468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7748f-e39f-4eb7-a439-f1f511070a21 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:48.973752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7748f-e39f-4eb7-a439-f1f511070a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:48.992128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4be7748f-e39f-4eb7-a439-f1f511070a21 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:48.993217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4be7748f-e39f-4eb7-a439-f1f511070a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:49.002185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 690/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:49.355388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7ac86-6de8-4dc8-8522-610ee3f028ff None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.355882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7ac86-6de8-4dc8-8522-610ee3f028ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.357335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7ac86-6de8-4dc8-8522-610ee3f028ff None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.359004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 684/1374] 10.222.0.61 () {54 vars in 963 bytes} [Mon Jul 4 09:23:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:49.363973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e788-f4c4-4ee7-9c17-4d458ca60239 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.364275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e788-f4c4-4ee7-9c17-4d458ca60239 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.364621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e788-f4c4-4ee7-9c17-4d458ca60239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.417992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8336e788-f4c4-4ee7-9c17-4d458ca60239 None None] MFA Rules not processed for user `0a987fcd616f48c09f4279f8dfb79740`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:49.419242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8336e788-f4c4-4ee7-9c17-4d458ca60239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:49.483535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 691/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Mon Jul 4 09:23:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:49.491348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7ac86-6de8-4dc8-8522-610ee3f028ff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:49.503752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7ac86-6de8-4dc8-8522-610ee3f028ff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:49.507273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:49.507918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:49.508200 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:49.508477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:49.518497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:49.519932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed748ee-1341-4c10-843e-3922c8147d58 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:49.531006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 685/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:50.760628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21706c-8694-4f21-acab-107b0da17053 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.761193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21706c-8694-4f21-acab-107b0da17053 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.761193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21706c-8694-4f21-acab-107b0da17053 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.762595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 692/1377] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:50.768432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032943-24ad-4f9e-bf22-61eac5075888 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.768844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032943-24ad-4f9e-bf22-61eac5075888 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.768996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032943-24ad-4f9e-bf22-61eac5075888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.786410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-36032943-24ad-4f9e-bf22-61eac5075888 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:50.787621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36032943-24ad-4f9e-bf22-61eac5075888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:50.795706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 686/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:50.842346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21706c-8694-4f21-acab-107b0da17053 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:50.857154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21706c-8694-4f21-acab-107b0da17053 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:50.862758 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:50.863404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:50.863691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:50.863973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:50.872489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:50.874989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83d008-2d97-4a4b-855f-4f022f86afe6 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:50.880452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:50.885096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 693/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:53.141419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b49fb-ea29-4e69-961c-8f4bbba2d5b2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.141949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b49fb-ea29-4e69-961c-8f4bbba2d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.142043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b49fb-ea29-4e69-961c-8f4bbba2d5b2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.143461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 687/1380] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:53.149064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824ad9-4c84-4134-9151-d50d85b897c6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.149468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824ad9-4c84-4134-9151-d50d85b897c6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.149626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88824ad9-4c84-4134-9151-d50d85b897c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.181966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-88824ad9-4c84-4134-9151-d50d85b897c6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:53.183511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-88824ad9-4c84-4134-9151-d50d85b897c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:53.194271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 694/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:53.242801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b49fb-ea29-4e69-961c-8f4bbba2d5b2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:53.269287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b49fb-ea29-4e69-961c-8f4bbba2d5b2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:53.280646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:53.281690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:53.281979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:53.282331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:53.292848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:53.294989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d335f1d-3b49-4b6f-82d7-2104eceb269d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:53.307532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 688/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:55.571685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea641-a62e-4161-80b5-115ee0ec7de9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:55.572247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea641-a62e-4161-80b5-115ee0ec7de9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:55.572247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea641-a62e-4161-80b5-115ee0ec7de9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:55.573628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 695/1383] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:55.579531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74d91-b826-403f-9e5e-550abd7fabbc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:55.579997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74d91-b826-403f-9e5e-550abd7fabbc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:55.580092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74d91-b826-403f-9e5e-550abd7fabbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:55.598828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b8c74d91-b826-403f-9e5e-550abd7fabbc None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:55.600037 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b8c74d91-b826-403f-9e5e-550abd7fabbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:55.622780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 689/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:55.652833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dea641-a62e-4161-80b5-115ee0ec7de9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:55.669411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dea641-a62e-4161-80b5-115ee0ec7de9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:55.675476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:55.676335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:55.676776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:55.677273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:55.688203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:55.689812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa519c-b3c4-4842-9c64-e450eb446130 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:55.700077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 696/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:23:57.754775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82daa-435c-47f9-9836-b1ea7fe0dd15 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:57.755329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82daa-435c-47f9-9836-b1ea7fe0dd15 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:57.755437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82daa-435c-47f9-9836-b1ea7fe0dd15 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:57.756772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 690/1386] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:23:57.764142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15291d-16c9-4bef-ae07-5399936cabb2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:57.764624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15291d-16c9-4bef-ae07-5399936cabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:57.764774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15291d-16c9-4bef-ae07-5399936cabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:57.783801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bb15291d-16c9-4bef-ae07-5399936cabb2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:23:57.785066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bb15291d-16c9-4bef-ae07-5399936cabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:23:57.795604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 697/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:23:57.841217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa82daa-435c-47f9-9836-b1ea7fe0dd15 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:23:57.856786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa82daa-435c-47f9-9836-b1ea7fe0dd15 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:23:57.863601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:23:57.864277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:23:57.864580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:23:57.864877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:23:57.875233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:23:57.876910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92299a14-f4ff-4a21-8cf5-28c4428cea80 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:23:57.887640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 691/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:00.323988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d9c-ca98-4a7b-9ebe-bc980a61e3e9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.324616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d9c-ca98-4a7b-9ebe-bc980a61e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.324616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d9c-ca98-4a7b-9ebe-bc980a61e3e9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.326050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 698/1389] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:00.331901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab47-a83b-4d02-bbe5-ba37b87337d5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.332521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab47-a83b-4d02-bbe5-ba37b87337d5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.332521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab47-a83b-4d02-bbe5-ba37b87337d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.350323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ad6bab47-a83b-4d02-bbe5-ba37b87337d5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:00.351455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ad6bab47-a83b-4d02-bbe5-ba37b87337d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:00.359744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 692/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:00.406177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9d9c-ca98-4a7b-9ebe-bc980a61e3e9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:00.422853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9d9c-ca98-4a7b-9ebe-bc980a61e3e9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:00.428308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:00.432414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:00.432414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:00.432414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:00.438242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:00.439841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06411a9-c630-4508-a9ee-5a2113334cad service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:00.449548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 699/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:02.839636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdff4a-c0cb-4ae2-a95e-a69d8a3e989b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:02.840283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdff4a-c0cb-4ae2-a95e-a69d8a3e989b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:02.840283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdff4a-c0cb-4ae2-a95e-a69d8a3e989b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:02.842410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 693/1392] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:02.847955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df20eb-1379-47a8-9c64-17db0551adb8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:02.848461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df20eb-1379-47a8-9c64-17db0551adb8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:02.848599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df20eb-1379-47a8-9c64-17db0551adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:02.868238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-20df20eb-1379-47a8-9c64-17db0551adb8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:02.869483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-20df20eb-1379-47a8-9c64-17db0551adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:02.879831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 700/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:02.931200 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdff4a-c0cb-4ae2-a95e-a69d8a3e989b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:02.946820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdff4a-c0cb-4ae2-a95e-a69d8a3e989b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:02.953262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:02.953935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:02.954257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:02.954559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:02.963723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:02.965814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f355-1396-4ffa-b36f-6d69923715ea service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:02.979266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 694/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:05.090547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de186cf-56a4-470c-9c59-95bc84a0114e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.091104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de186cf-56a4-470c-9c59-95bc84a0114e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.091104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de186cf-56a4-470c-9c59-95bc84a0114e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.093023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 701/1395] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:05.098566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8e5e-86d4-4036-8e20-f2f638f2631c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.099001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8e5e-86d4-4036-8e20-f2f638f2631c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.099235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8e5e-86d4-4036-8e20-f2f638f2631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.117876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-af7c8e5e-86d4-4036-8e20-f2f638f2631c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:05.119093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-af7c8e5e-86d4-4036-8e20-f2f638f2631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:05.127961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 695/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:05.177386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b004790-0166-4fd8-934b-141256aa296a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.177677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b004790-0166-4fd8-934b-141256aa296a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.177957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b004790-0166-4fd8-934b-141256aa296a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.179368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 702/1397] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:05.184639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.184934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.185299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.185548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a630-432b-4321-a741-2beefa0b09b1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.186009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a630-432b-4321-a741-2beefa0b09b1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.186873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a630-432b-4321-a741-2beefa0b09b1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.188157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 703/1398] 10.222.0.61 () {54 vars in 962 bytes} [Mon Jul 4 09:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:24:05.193086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec4f2-ddfe-451e-b0e2-e67aee129655 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.193307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec4f2-ddfe-451e-b0e2-e67aee129655 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.193589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec4f2-ddfe-451e-b0e2-e67aee129655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.205441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:05.206708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:05.218219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 696/1399] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:05.247891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e47ec4f2-ddfe-451e-b0e2-e67aee129655 None None] MFA Rules not processed for user `07a39dae9c774d8a8f4755e9a0c2596d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:05.249859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e47ec4f2-ddfe-451e-b0e2-e67aee129655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:05.264052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:05.276083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d901cc-3327-44ac-aa43-6821b38e6822 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:05.281542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:05.282243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.282539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.282817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.291543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:05.293136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:05.303396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 697/1400] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:24:05.313339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 704/1401] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Jul 4 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:05.320927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:05.329834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844cdf-993c-4089-ac25-b182261138ed service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:05.333601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:05.334253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:05.334542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:05.334820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:05.344099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:05.345510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d210e-cc68-44e3-8923-58c4a4b5a0bc service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:05.355043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 698/1402] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:06.210771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead74abf-3ab7-44aa-81d9-b622855faf79 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:06.211263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead74abf-3ab7-44aa-81d9-b622855faf79 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:06.211380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead74abf-3ab7-44aa-81d9-b622855faf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:06.266246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ead74abf-3ab7-44aa-81d9-b622855faf79 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:06.274315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ead74abf-3ab7-44aa-81d9-b622855faf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:06.331336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:06.334867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 705/1403] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:06.379767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481bae-4cb2-4a7b-85ff-493247eb0772 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:06.380236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481bae-4cb2-4a7b-85ff-493247eb0772 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:06.380346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481bae-4cb2-4a7b-85ff-493247eb0772 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:06.381735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 699/1404] 10.222.0.61 () {54 vars in 942 bytes} [Mon Jul 4 09:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:06.388262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1c675-990c-40cc-9cf0-3fbb851ce4c3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:06.388566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1c675-990c-40cc-9cf0-3fbb851ce4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:06.389455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1c675-990c-40cc-9cf0-3fbb851ce4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:06.438152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-21f1c675-990c-40cc-9cf0-3fbb851ce4c3 None None] MFA Rules not processed for user `ab9bf3dd7ae04319987bd7a26c94ed20`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:06.439396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-21f1c675-990c-40cc-9cf0-3fbb851ce4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:06.512334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 706/1405] 10.222.0.61 () {58 vars in 1039 bytes} [Mon Jul 4 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:06.522416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92481bae-4cb2-4a7b-85ff-493247eb0772 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:06.530148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=70 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:06.536536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92481bae-4cb2-4a7b-85ff-493247eb0772 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:06.541559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:06.544979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:06.544979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:06.544979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:06.551402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:06.552987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700244-8c70-4801-ae21-be2008d27ac5 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:06.561892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 700/1406] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:07.541949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc075-724c-4774-9843-9b792f07ebe4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.542567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc075-724c-4774-9843-9b792f07ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.542567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc075-724c-4774-9843-9b792f07ebe4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.543893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 707/1407] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:24:07.549184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38417a-d495-42b5-9057-60bc1d64cef6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.549596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38417a-d495-42b5-9057-60bc1d64cef6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.549748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38417a-d495-42b5-9057-60bc1d64cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.568447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fb38417a-d495-42b5-9057-60bc1d64cef6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:07.569667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb38417a-d495-42b5-9057-60bc1d64cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:07.578167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 701/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:07.624517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafc075-724c-4774-9843-9b792f07ebe4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:07.641812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafc075-724c-4774-9843-9b792f07ebe4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:07.648427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:07.649091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:07.649427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:07.649724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:07.660992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:07.662907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb0c76-f105-47ca-a22f-58d40815f3f0 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:07.673546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 708/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:17.562325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=8 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:17.669661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=50 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:30.439417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1ba-a7e1-4187-9278-84776b5bd543 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.440050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1ba-a7e1-4187-9278-84776b5bd543 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.440050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1ba-a7e1-4187-9278-84776b5bd543 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.441432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 702/1410] 10.222.0.61 () {54 vars in 918 bytes} [Mon Jul 4 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:30.446543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f269-b850-491f-9f7b-5f6580161aec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.446995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f269-b850-491f-9f7b-5f6580161aec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.447093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f269-b850-491f-9f7b-5f6580161aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.466646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4452f269-b850-491f-9f7b-5f6580161aec None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:30.467920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4452f269-b850-491f-9f7b-5f6580161aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:30.476576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 709/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 4 09:24:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:30.491518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc91d9-7075-4ce9-a18d-97a445965695 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.491814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc91d9-7075-4ce9-a18d-97a445965695 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.492096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc91d9-7075-4ce9-a18d-97a445965695 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.493514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 703/1412] 10.222.0.61 () {54 vars in 918 bytes} [Mon Jul 4 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:30.498368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f368bd-3fdc-4b80-a290-2b82690eb15c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:30.498672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f368bd-3fdc-4b80-a290-2b82690eb15c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:30.499209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f368bd-3fdc-4b80-a290-2b82690eb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:30.516790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-84f368bd-3fdc-4b80-a290-2b82690eb15c None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:30.517966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-84f368bd-3fdc-4b80-a290-2b82690eb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:30.526961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 710/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 4 09:24:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:24:33.062131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcfa3-0a2c-4fe0-9c5d-9a7f05d45521 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:33.062720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcfa3-0a2c-4fe0-9c5d-9a7f05d45521 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:33.062948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadcfa3-0a2c-4fe0-9c5d-9a7f05d45521 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:33.064234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:33.069562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bea8-efbf-4507-8e50-1de919cff2a0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:33.070035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bea8-efbf-4507-8e50-1de919cff2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:33.070147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824bea8-efbf-4507-8e50-1de919cff2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:33.088657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f824bea8-efbf-4507-8e50-1de919cff2a0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:33.089858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f824bea8-efbf-4507-8e50-1de919cff2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:33.097733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:33.141885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadcfa3-0a2c-4fe0-9c5d-9a7f05d45521 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:33.175990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadcfa3-0a2c-4fe0-9c5d-9a7f05d45521 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:33.175990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:33.175990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:33.175990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:33.176668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:33.176668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:33.176668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7e54f-7aa7-4b24-bc39-1c53bc809f9a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:33.183556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 705/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:34.100638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767f42-2190-4fe9-974d-34aaeec9be36 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.101208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767f42-2190-4fe9-974d-34aaeec9be36 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.101208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767f42-2190-4fe9-974d-34aaeec9be36 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.102678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:34.107727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3d38-1568-4aed-a5b5-0a6a8d979177 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.108160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3d38-1568-4aed-a5b5-0a6a8d979177 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.108283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3d38-1568-4aed-a5b5-0a6a8d979177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.127206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e6a3d38-1568-4aed-a5b5-0a6a8d979177 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:34.128399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e6a3d38-1568-4aed-a5b5-0a6a8d979177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:34.136120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:34.285454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767f42-2190-4fe9-974d-34aaeec9be36 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:34.300467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767f42-2190-4fe9-974d-34aaeec9be36 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:34.305930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:34.306596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:34.306914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:34.307196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:34.315467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:34.317222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb863b6-4069-4ee5-a67d-dbda56532a57 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:34.326751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 713/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:35.209713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00c21-7122-45b9-9ce0-7f483ac7c7e6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.210301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00c21-7122-45b9-9ce0-7f483ac7c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.210400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00c21-7122-45b9-9ce0-7f483ac7c7e6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.211826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:35.217549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4b3c-e893-45a5-a4cf-7fb50a8ac508 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.217967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4b3c-e893-45a5-a4cf-7fb50a8ac508 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.218110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4b3c-e893-45a5-a4cf-7fb50a8ac508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.236632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3d7c4b3c-e893-45a5-a4cf-7fb50a8ac508 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:35.237848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3d7c4b3c-e893-45a5-a4cf-7fb50a8ac508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:35.245808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:35.398782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00c21-7122-45b9-9ce0-7f483ac7c7e6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:35.413734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00c21-7122-45b9-9ce0-7f483ac7c7e6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:35.419685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:35.420509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:35.420804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:35.421088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:35.430051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:35.431778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f3ba-56b2-4ba9-bd38-af1b5af0d9e2 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:35.441996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 708/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:36.306943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d412c8c-54b4-46c5-b2c4-a47e6210634a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.307513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d412c8c-54b4-46c5-b2c4-a47e6210634a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.307513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d412c8c-54b4-46c5-b2c4-a47e6210634a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.309413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:36.314526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff92e0-b167-45bb-952e-62ff4eec2378 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.314934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff92e0-b167-45bb-952e-62ff4eec2378 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.315105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff92e0-b167-45bb-952e-62ff4eec2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.333485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0dff92e0-b167-45bb-952e-62ff4eec2378 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:36.334787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0dff92e0-b167-45bb-952e-62ff4eec2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:36.342888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:36.492919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d412c8c-54b4-46c5-b2c4-a47e6210634a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:36.508059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d412c8c-54b4-46c5-b2c4-a47e6210634a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:36.514111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:36.514781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:36.515071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:36.515352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:36.523460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:36.525048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea136bee-1509-4d74-9d24-714ab94b5c8d service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:36.534483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 716/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:37.398570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e549-f4b1-4f43-a3ba-71461db1043b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.399108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e549-f4b1-4f43-a3ba-71461db1043b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.399239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e549-f4b1-4f43-a3ba-71461db1043b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.400518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:37.406046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382df68-6d0a-4c1f-971e-9558f1e0261d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.406480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382df68-6d0a-4c1f-971e-9558f1e0261d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.406652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382df68-6d0a-4c1f-971e-9558f1e0261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.424285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a382df68-6d0a-4c1f-971e-9558f1e0261d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:37.425491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a382df68-6d0a-4c1f-971e-9558f1e0261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:37.433353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:37.584705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e549-f4b1-4f43-a3ba-71461db1043b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:37.599727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e549-f4b1-4f43-a3ba-71461db1043b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:37.605006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:37.606396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:37.606396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:37.606396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:37.614675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:37.616237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9277a35-e9f6-4976-88c1-aea15b3b2279 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:37.626048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 711/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:38.539260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0d55-af23-459f-8f2d-eb079983671b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.539832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0d55-af23-459f-8f2d-eb079983671b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.539832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d0d55-af23-459f-8f2d-eb079983671b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.541203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:38.546207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9094-649c-4668-883b-911c0e307492 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.546653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9094-649c-4668-883b-911c0e307492 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.546792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9094-649c-4668-883b-911c0e307492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.564996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6f4e9094-649c-4668-883b-911c0e307492 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:38.566188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f4e9094-649c-4668-883b-911c0e307492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:38.574996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:38.729726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d0d55-af23-459f-8f2d-eb079983671b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:38.744160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d0d55-af23-459f-8f2d-eb079983671b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:38.750318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:38.750960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:38.751250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:38.751532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:38.759807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:38.761386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1ef53-31e4-4d6f-aaa8-050bcf4a248c service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:38.771708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 719/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:39.651621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a11cac-92e9-4cb0-a437-acb0bee04f6b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.652238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a11cac-92e9-4cb0-a437-acb0bee04f6b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.652238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a11cac-92e9-4cb0-a437-acb0bee04f6b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.653643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:39.658616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d98-de53-4b86-b9e7-1b85c69b2b26 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.659032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d98-de53-4b86-b9e7-1b85c69b2b26 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.659202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d98-de53-4b86-b9e7-1b85c69b2b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.677112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f2635d98-de53-4b86-b9e7-1b85c69b2b26 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:39.678347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2635d98-de53-4b86-b9e7-1b85c69b2b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:39.686733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:39.838970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a11cac-92e9-4cb0-a437-acb0bee04f6b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:39.853205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a11cac-92e9-4cb0-a437-acb0bee04f6b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:39.859159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:39.859829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:39.860118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:39.860395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:39.868567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:39.870146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3373d5-44eb-4ed4-8cca-a682455eb5c6 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:39.881249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 714/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:40.821788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bef793-b024-41e7-b19a-4fccc159ae32 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:40.822359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bef793-b024-41e7-b19a-4fccc159ae32 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:40.822359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bef793-b024-41e7-b19a-4fccc159ae32 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:40.823693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:40.828873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd705c-ca78-4f12-b384-e53ee320bd6b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:40.829328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd705c-ca78-4f12-b384-e53ee320bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:40.829448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd705c-ca78-4f12-b384-e53ee320bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:40.847434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2ebd705c-ca78-4f12-b384-e53ee320bd6b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:40.848614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2ebd705c-ca78-4f12-b384-e53ee320bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:40.856943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:41.011333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bef793-b024-41e7-b19a-4fccc159ae32 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:41.025708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bef793-b024-41e7-b19a-4fccc159ae32 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:41.031759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:41.032430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:41.032718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:41.033003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:41.041490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:41.043803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cfe7a-66d1-49a5-b40d-ef9ec772df97 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:41.054031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 722/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:41.922902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccd396-6d2d-43b6-8fd1-b1301ba6ee55 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:41.923437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccd396-6d2d-43b6-8fd1-b1301ba6ee55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:41.923437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccd396-6d2d-43b6-8fd1-b1301ba6ee55 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:41.924789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:41.929743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa181-16ac-4181-9d4d-d45776e0395e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:41.930180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa181-16ac-4181-9d4d-d45776e0395e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:41.930356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa181-16ac-4181-9d4d-d45776e0395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:41.949679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ccfaa181-16ac-4181-9d4d-d45776e0395e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:41.950926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ccfaa181-16ac-4181-9d4d-d45776e0395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:41.958852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:42.111434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccd396-6d2d-43b6-8fd1-b1301ba6ee55 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:42.126552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccd396-6d2d-43b6-8fd1-b1301ba6ee55 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:42.132065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:42.132698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:42.132981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:42.133255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:42.141577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:42.143178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09ac6-c955-41fd-870f-81634fbed970 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:42.152489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 717/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:44.084673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978d85-f635-4b21-be66-59ab2af4ce46 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:44.085245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978d85-f635-4b21-be66-59ab2af4ce46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:44.085245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978d85-f635-4b21-be66-59ab2af4ce46 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:44.086755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:44.092963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc098-28b5-476a-ad8b-d7e8b3e72b8f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:44.093446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc098-28b5-476a-ad8b-d7e8b3e72b8f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:44.093543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc098-28b5-476a-ad8b-d7e8b3e72b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:44.111813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ba9dc098-28b5-476a-ad8b-d7e8b3e72b8f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:44.115762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba9dc098-28b5-476a-ad8b-d7e8b3e72b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:44.121448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:44.162232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978d85-f635-4b21-be66-59ab2af4ce46 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:44.174081 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978d85-f635-4b21-be66-59ab2af4ce46 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:44.177875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:44.178574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:44.184616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:44.184616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:44.189824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:44.191396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0473268-7684-4fbd-8d59-49f0ba4ce5fb service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:44.201325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 725/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:46.391236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326bb-cd75-45ab-a7c8-c536b92d5b75 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:46.391799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326bb-cd75-45ab-a7c8-c536b92d5b75 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:46.391799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c326bb-cd75-45ab-a7c8-c536b92d5b75 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:46.393233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:46.398502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5d8c-3d02-41e8-aa81-768307adfd27 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:46.398889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5d8c-3d02-41e8-aa81-768307adfd27 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:46.399072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5d8c-3d02-41e8-aa81-768307adfd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:46.417119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-85fb5d8c-3d02-41e8-aa81-768307adfd27 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:46.418388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85fb5d8c-3d02-41e8-aa81-768307adfd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:46.426161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:46.464824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c326bb-cd75-45ab-a7c8-c536b92d5b75 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:46.475860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c326bb-cd75-45ab-a7c8-c536b92d5b75 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:46.479366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:46.480072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:46.480333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:46.480595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:46.489902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:46.491373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea0628-2f95-4aeb-9ada-d0e719b34b59 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:46.501125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 720/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:48.952137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ac73-b4df-499b-a399-f425238c4fdc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:48.952715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ac73-b4df-499b-a399-f425238c4fdc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:48.952715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ac73-b4df-499b-a399-f425238c4fdc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:48.954080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:48.959588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5032b-bff8-4a33-94c3-f152516fbf82 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:48.960041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5032b-bff8-4a33-94c3-f152516fbf82 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:48.960153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5032b-bff8-4a33-94c3-f152516fbf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:48.978545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-86a5032b-bff8-4a33-94c3-f152516fbf82 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:48.979781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-86a5032b-bff8-4a33-94c3-f152516fbf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:48.987652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:49.027028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522ac73-b4df-499b-a399-f425238c4fdc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:49.037796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522ac73-b4df-499b-a399-f425238c4fdc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:49.041390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:49.042026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:49.042341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:49.042621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:49.051653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:49.053087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ace38-e34f-40d4-98a3-148ba27aa801 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:49.063155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 728/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:51.235266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc3d1-783b-4d91-bd2b-56f26f648f7d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.235702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc3d1-783b-4d91-bd2b-56f26f648f7d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.235814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc3d1-783b-4d91-bd2b-56f26f648f7d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.237189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:51.242399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c462-378f-4b1c-91e9-80b7ecb93b0e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.242800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c462-378f-4b1c-91e9-80b7ecb93b0e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.242967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c462-378f-4b1c-91e9-80b7ecb93b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.261321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fea5c462-378f-4b1c-91e9-80b7ecb93b0e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:51.262565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fea5c462-378f-4b1c-91e9-80b7ecb93b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:51.270509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:51.309357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc3d1-783b-4d91-bd2b-56f26f648f7d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:51.320361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc3d1-783b-4d91-bd2b-56f26f648f7d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:51.323971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:51.324612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:51.324899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:51.325463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:51.334717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:51.336143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294ffa4-6cfc-4dfa-a72e-9de7406c83d2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:51.346228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 723/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:53.446865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7821ca-539d-4efb-a014-d686358e2832 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:53.447447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7821ca-539d-4efb-a014-d686358e2832 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:53.447447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7821ca-539d-4efb-a014-d686358e2832 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:53.449400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:53.455057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb306cb-67a0-40c1-a022-c28f1a323e50 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:53.455585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb306cb-67a0-40c1-a022-c28f1a323e50 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:53.455681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb306cb-67a0-40c1-a022-c28f1a323e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:53.473855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7eb306cb-67a0-40c1-a022-c28f1a323e50 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:53.475091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7eb306cb-67a0-40c1-a022-c28f1a323e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:53.483230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:53.525966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7821ca-539d-4efb-a014-d686358e2832 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:53.536835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7821ca-539d-4efb-a014-d686358e2832 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:53.540402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:53.541049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:53.541337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:53.541619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:53.551027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:53.552474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77bd6-9108-47b8-b2d7-4e66343d1439 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:53.562740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 731/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:55.667241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:55.667771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:55.667886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:55.669507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:55.675012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbe59-9d11-4008-831e-08db633fba87 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:55.675436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbe59-9d11-4008-831e-08db633fba87 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:55.675601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbe59-9d11-4008-831e-08db633fba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:55.693237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8bbfbe59-9d11-4008-831e-08db633fba87 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:55.694544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8bbfbe59-9d11-4008-831e-08db633fba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:55.703013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:55.742070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:55.743809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:55.757505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527596-6924-42cb-919f-9244ec650fa8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:55.761393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:55.762031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:55.762361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:55.762648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:55.772104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:55.773532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3e13-fe28-4347-b828-c8cbb6ea4402 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:55.783733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 726/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:24:57.908567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd6eb-a829-425c-99ef-8562df4ff2e1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:57.909136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd6eb-a829-425c-99ef-8562df4ff2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:57.909136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd6eb-a829-425c-99ef-8562df4ff2e1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:57.910573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:24:57.916036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a227-1e2f-44c5-b86c-538e5ba988f4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:57.916440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a227-1e2f-44c5-b86c-538e5ba988f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:57.916606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a227-1e2f-44c5-b86c-538e5ba988f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:57.923193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=70 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:57.935696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a040a227-1e2f-44c5-b86c-538e5ba988f4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:24:57.941469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a040a227-1e2f-44c5-b86c-538e5ba988f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:24:57.944977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:24:57.983047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd6eb-a829-425c-99ef-8562df4ff2e1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:24:57.988447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=73 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:57.994440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd6eb-a829-425c-99ef-8562df4ff2e1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:24:57.998951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:24:57.999592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:24:57.999870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:24:58.000144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:24:58.009297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:24:58.010817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb7936-13a7-4afe-a1b0-1b7f29614adc service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:24:58.020109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 734/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:00.095056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18e92-c859-491d-b28d-392b491d48e1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:00.095597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18e92-c859-491d-b28d-392b491d48e1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:00.095721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18e92-c859-491d-b28d-392b491d48e1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:00.097063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:00.102530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85358eb2-7a7b-4fe3-86c5-6ffc79e06aff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:00.102957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85358eb2-7a7b-4fe3-86c5-6ffc79e06aff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:00.103102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85358eb2-7a7b-4fe3-86c5-6ffc79e06aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:00.121987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-85358eb2-7a7b-4fe3-86c5-6ffc79e06aff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:00.123232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85358eb2-7a7b-4fe3-86c5-6ffc79e06aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:00.131406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:00.168667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18e92-c859-491d-b28d-392b491d48e1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:00.181351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18e92-c859-491d-b28d-392b491d48e1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:00.200985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:00.201983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:00.202499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:00.202850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:00.216573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:00.218326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ef14-21d7-422d-a1c0-418a701b8cf2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:00.228906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 729/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:02.298848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fb7c-a0fc-4b03-bd19-4db6bf09b382 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:02.299406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fb7c-a0fc-4b03-bd19-4db6bf09b382 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:02.299406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fb7c-a0fc-4b03-bd19-4db6bf09b382 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:02.300830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:02.306391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597902f-8f08-4034-8899-2b5515045700 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:02.306878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597902f-8f08-4034-8899-2b5515045700 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:02.306974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597902f-8f08-4034-8899-2b5515045700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:02.331019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b597902f-8f08-4034-8899-2b5515045700 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:02.334518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b597902f-8f08-4034-8899-2b5515045700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:02.342592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:02.380105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7fb7c-a0fc-4b03-bd19-4db6bf09b382 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:02.391071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7fb7c-a0fc-4b03-bd19-4db6bf09b382 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:02.394659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:02.395275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:02.395563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:02.395846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:02.404912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:02.406432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1d0d-581a-4940-927a-1e91260cbb3f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:02.416930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 737/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:04.488915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af84a-826a-481f-8b65-5579b285f103 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:04.489487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af84a-826a-481f-8b65-5579b285f103 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:04.489487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af84a-826a-481f-8b65-5579b285f103 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:04.490986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:04.496587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718a23-af06-4da5-931f-ff686f1d4dff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:04.497062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718a23-af06-4da5-931f-ff686f1d4dff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:04.497159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718a23-af06-4da5-931f-ff686f1d4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:04.515906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64718a23-af06-4da5-931f-ff686f1d4dff None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:04.517155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64718a23-af06-4da5-931f-ff686f1d4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:04.525235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:04.563188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609af84a-826a-481f-8b65-5579b285f103 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:04.574690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609af84a-826a-481f-8b65-5579b285f103 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:04.578223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:04.578872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:04.579153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:04.579434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:04.589528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:04.590998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908302-74da-4b16-9ade-310d29d7092e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:04.600741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 732/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:14.510654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=17 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:14.596255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=17 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:24.779044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc0dd7-193a-429c-9358-80e3d57cc71f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.779629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc0dd7-193a-429c-9358-80e3d57cc71f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.779629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc0dd7-193a-429c-9358-80e3d57cc71f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.781044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 739/1471] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:24.786387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08333-bc08-491f-a03e-62b7851321c7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.786919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08333-bc08-491f-a03e-62b7851321c7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.787031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08333-bc08-491f-a03e-62b7851321c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.804439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dff08333-bc08-491f-a03e-62b7851321c7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:24.805641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dff08333-bc08-491f-a03e-62b7851321c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.813509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 733/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:25:24.898273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8764-1c66-404c-9798-6bd9e039206c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.898567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8764-1c66-404c-9798-6bd9e039206c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.898851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8764-1c66-404c-9798-6bd9e039206c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.901060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 740/1473] 10.222.0.61 () {54 vars in 962 bytes} [Mon Jul 4 09:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:24.907258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452d25-916d-4277-9353-3977c2050048 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.907550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452d25-916d-4277-9353-3977c2050048 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.907830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452d25-916d-4277-9353-3977c2050048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.925513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e8452d25-916d-4277-9353-3977c2050048 None None] MFA Rules not processed for user `07a39dae9c774d8a8f4755e9a0c2596d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:24.926801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e8452d25-916d-4277-9353-3977c2050048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:24.933328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 734/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Jul 4 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:24.940765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a8764-1c66-404c-9798-6bd9e039206c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:24.952038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a8764-1c66-404c-9798-6bd9e039206c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:24.955560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:24.956206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:24.956497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:24.956777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:24.968162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:24.969620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d954d03-c410-44c4-b4a3-a97969b028ce service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:24.979234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 741/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:27.106789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17ce-92ca-4b20-8a90-be949e5ca278 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:27.107397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17ce-92ca-4b20-8a90-be949e5ca278 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:27.107397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17ce-92ca-4b20-8a90-be949e5ca278 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:27.108779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 735/1476] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:27.114257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a984-1d0c-4225-b1e6-a79dea8dee24 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:27.114714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a984-1d0c-4225-b1e6-a79dea8dee24 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:27.114825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a984-1d0c-4225-b1e6-a79dea8dee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:27.133097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b7b1a984-1d0c-4225-b1e6-a79dea8dee24 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:27.134381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b7b1a984-1d0c-4225-b1e6-a79dea8dee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:27.142430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 742/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:27.166958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a17ce-92ca-4b20-8a90-be949e5ca278 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:27.179514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a17ce-92ca-4b20-8a90-be949e5ca278 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:27.186338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:27.187002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:27.187292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:27.187576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:27.188352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:27.190084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:25:27.190084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:25:27.190084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:25:27.191283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceaba8-ef5d-4c53-afd6-4c5d5c7ae165 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:27.215114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 736/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Jul 4 09:25:27 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:25:29.347558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af99f-6ec9-4987-a9eb-c245c522abae None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:29.348147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af99f-6ec9-4987-a9eb-c245c522abae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:29.348147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af99f-6ec9-4987-a9eb-c245c522abae None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:29.349505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 743/1479] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:29.355132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a742bc-9cfe-4fb2-a4d4-fa61cb27715e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:29.355561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a742bc-9cfe-4fb2-a4d4-fa61cb27715e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:29.355704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a742bc-9cfe-4fb2-a4d4-fa61cb27715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:29.374655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-30a742bc-9cfe-4fb2-a4d4-fa61cb27715e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:29.375915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30a742bc-9cfe-4fb2-a4d4-fa61cb27715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:29.383862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 737/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:29.427308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190af99f-6ec9-4987-a9eb-c245c522abae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:29.441757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190af99f-6ec9-4987-a9eb-c245c522abae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:29.447751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:29.448428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:29.448722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:29.449001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:29.457430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:29.464213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eb91a-e65a-4f2c-b7aa-7ab9dc42a101 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:29.469151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 744/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:31.687564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8e529-8fcb-4ddd-b2eb-0b524c02b86f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:31.688093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8e529-8fcb-4ddd-b2eb-0b524c02b86f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:31.688212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8e529-8fcb-4ddd-b2eb-0b524c02b86f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:31.689530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 738/1482] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:31.695133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7cbf-278b-4ec5-8749-344f9d3530f5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:31.695631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7cbf-278b-4ec5-8749-344f9d3530f5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:31.695730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e7cbf-278b-4ec5-8749-344f9d3530f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:31.713438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bd1e7cbf-278b-4ec5-8749-344f9d3530f5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:31.714724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bd1e7cbf-278b-4ec5-8749-344f9d3530f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:31.722738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 745/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:31.760554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8e529-8fcb-4ddd-b2eb-0b524c02b86f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:31.771425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8e529-8fcb-4ddd-b2eb-0b524c02b86f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:31.775762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:31.776478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:31.776768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:31.777050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:31.786450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:31.787887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b336-67bc-4696-a224-1ee07a96ddef service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:31.798230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 739/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:33.916789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8f57-72e6-4921-9c62-ca673114828b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:33.917343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8f57-72e6-4921-9c62-ca673114828b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:33.917343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8f57-72e6-4921-9c62-ca673114828b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:33.918697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 746/1485] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:33.924025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b291f-43a4-42a5-97e7-85f3edd750a0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:33.924452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b291f-43a4-42a5-97e7-85f3edd750a0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:33.924594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b291f-43a4-42a5-97e7-85f3edd750a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:33.942139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-784b291f-43a4-42a5-97e7-85f3edd750a0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:33.943517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-784b291f-43a4-42a5-97e7-85f3edd750a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:33.952264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 740/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:33.990933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8f57-72e6-4921-9c62-ca673114828b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:34.002852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8f57-72e6-4921-9c62-ca673114828b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:34.006434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:34.007074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:34.007368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:34.007651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:34.017433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:34.018920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942063-bc69-47e1-894d-21aac4013cb8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:34.028968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 747/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:36.228020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3526-3623-4a37-a7b0-508860db62c7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:36.228611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3526-3623-4a37-a7b0-508860db62c7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:36.228611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3526-3623-4a37-a7b0-508860db62c7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:36.230011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 741/1488] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:36.235611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a61d13-0876-45ae-a0e3-7e408232e14c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:36.236054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a61d13-0876-45ae-a0e3-7e408232e14c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:36.236160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a61d13-0876-45ae-a0e3-7e408232e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:36.255244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-11a61d13-0876-45ae-a0e3-7e408232e14c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:36.256445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-11a61d13-0876-45ae-a0e3-7e408232e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:36.264318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 748/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:36.305934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3526-3623-4a37-a7b0-508860db62c7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:36.316754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3526-3623-4a37-a7b0-508860db62c7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:36.320354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:36.320983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:36.321266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:36.321545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:36.330542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:36.331961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19ed1-e335-436d-8cbb-8f385b832fff service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:36.343156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 742/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:38.869002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423c37-1b5c-4723-811e-28176785e935 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:38.869579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423c37-1b5c-4723-811e-28176785e935 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:38.869579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9423c37-1b5c-4723-811e-28176785e935 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:38.871006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 749/1491] 10.222.0.61 () {54 vars in 926 bytes} [Mon Jul 4 09:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:25:38.876789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d247-9cff-4da1-aef6-07458dc27b6a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:38.877184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d247-9cff-4da1-aef6-07458dc27b6a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:38.877345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d247-9cff-4da1-aef6-07458dc27b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:38.895350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8543d247-9cff-4da1-aef6-07458dc27b6a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:25:38.897069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8543d247-9cff-4da1-aef6-07458dc27b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:25:38.904809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 743/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Mon Jul 4 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:25:38.944440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9423c37-1b5c-4723-811e-28176785e935 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:25:38.955627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9423c37-1b5c-4723-811e-28176785e935 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:25:38.959360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:25:38.959999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:25:38.960286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:25:38.960565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:25:38.970293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:25:38.971724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e17ee-da0f-4f5f-b126-892bb1386fc8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:25:38.981217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 750/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:25:48.890316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=33 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:48.977026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=33 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:16.420947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.421522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.421522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.440014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:16.441222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:16.449220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 744/1494] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:16.457622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.458127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.458263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.476114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:16.477289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:16.485304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 751/1495] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:16.490704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.501325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd362-ed8e-4f3d-8b73-db70dd9329eb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.506092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.506940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.507224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.507501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.508221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:27:16.508526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.509536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.509536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:27:16.509536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:27:16.510461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:16.521948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 745/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:27:16.529891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.539485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbd774-6700-4fa8-804e-f930c43d4d4a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.543993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.544638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.544920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.545195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.545885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.547681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.547681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:27:16.547681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:27:16.548885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:16.650473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 752/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:27:16.654854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.665621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5d31-270e-4c8f-bb44-593450591956 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.726595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.727314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.727593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.727873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.728580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.729612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.729612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:27:16.729612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:27:16.730848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:16.820263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 746/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:27:16 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:27:16.824534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.835848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb665-2a82-4d5f-8b93-0cc0525b0b47 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.841978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.841978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.841978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.842361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.842986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.844013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.844013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:27:16.844013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:27:16.844906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:16.858778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 753/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:27:16.863304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.874569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a15dc-b0b1-4fd1-8719-61c3d1e02b5b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.879459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.882040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.882040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.882040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.882040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.882785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.882785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:27:16.882785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:27:16.883744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616bec6-88c3-4d92-aab4-77c10843fe0a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:16.899115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 747/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:27:16.903353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:16.914085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223c5e5-7d95-4d28-b13c-42f979cd3189 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:16.918807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:16.919843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:16.920131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:16.920413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] PATH_INFO: `/v3/projects/eecb0bd4d5d1445fa05173fb01055f39/users/e95b8ec1c49341c7a3adf2d9d3a3dde7/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:16.936029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecb0bd4d5d1445fa05173fb01055f39, user_id=e95b8ec1c49341c7a3adf2d9d3a3dde7, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:16.937068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:16.937068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:27:16.937068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:27:16.939166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68d09-3524-46a9-a607-c5dcb196a9a2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:17.008354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 754/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:27:16 2022] PUT /identity/v3/projects/eecb0bd4d5d1445fa05173fb01055f39/users/e95b8ec1c49341c7a3adf2d9d3a3dde7/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:27:17.020491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858649c3-5a44-42ca-91f7-0854a07f5f1b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.020794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858649c3-5a44-42ca-91f7-0854a07f5f1b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.021605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858649c3-5a44-42ca-91f7-0854a07f5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.047968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-858649c3-5a44-42ca-91f7-0854a07f5f1b None None] MFA Rules not processed for user `e95b8ec1c49341c7a3adf2d9d3a3dde7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:17.049184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-858649c3-5a44-42ca-91f7-0854a07f5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:17.113725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 748/1502] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:27:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:17.127215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a9f7-224a-4b16-80a3-b6bb84805675 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.127504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a9f7-224a-4b16-80a3-b6bb84805675 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.127785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a9f7-224a-4b16-80a3-b6bb84805675 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.129187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 755/1503] 10.222.0.61 () {54 vars in 963 bytes} [Mon Jul 4 09:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:27:17.134269 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d55886-97fa-493c-9cb4-8b04a74d78fd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.134563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d55886-97fa-493c-9cb4-8b04a74d78fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.134844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d55886-97fa-493c-9cb4-8b04a74d78fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.152904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-16d55886-97fa-493c-9cb4-8b04a74d78fd None None] MFA Rules not processed for user `0a987fcd616f48c09f4279f8dfb79740`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:17.154101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16d55886-97fa-493c-9cb4-8b04a74d78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:17.197898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.205035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 749/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Mon Jul 4 09:27:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:17.213379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a9f7-224a-4b16-80a3-b6bb84805675 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:17.224852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a9f7-224a-4b16-80a3-b6bb84805675 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:17.228468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:17.229121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.229418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.229744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.238772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:17.240271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:17.249784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 756/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:27:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:27:17.294159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e486-f5b8-43e7-8337-bfb32493a537 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.294485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e486-f5b8-43e7-8337-bfb32493a537 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.294771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e486-f5b8-43e7-8337-bfb32493a537 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.296087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 750/1506] 10.222.0.61 () {52 vars in 829 bytes} [Mon Jul 4 09:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:27:17.299637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:17.366968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b7f8-0812-44f2-8794-0064130f71f9 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:17.371518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:17.372789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.373126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.373407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] PATH_INFO: `/v3/users/e95b8ec1c49341c7a3adf2d9d3a3dde7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.374652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95b8ec1c49341c7a3adf2d9d3a3dde7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:17.375892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:17.375892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:27:17.375892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:27:17.377376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:17.574992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95b8ec1c49341c7a3adf2d9d3a3dde7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:17.575861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95b8ec1c49341c7a3adf2d9d3a3dde7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:17.648575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95b8ec1c49341c7a3adf2d9d3a3dde7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:17.661659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95b8ec1c49341c7a3adf2d9d3a3dde7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:17.662522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95b8ec1c49341c7a3adf2d9d3a3dde7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:17.679315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.687053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 757/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:27:17 2022] DELETE /identity/v3/users/e95b8ec1c49341c7a3adf2d9d3a3dde7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:27:17.691518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.691984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.692085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.711536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:27:17.712750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:17.771981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 751/1508] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:27:17.781463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:17.783849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:17.841670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cf7a1-7d84-4bc9-afa5-0c8ba26bf16c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:17.845364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:17.846011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:17.846340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:17.846622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:17.856054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:17.857717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867eb38-1bdb-48ac-a84f-a370f7a3afbd service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:17.868653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 758/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:27:18.353376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:27:18.354855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:27:18.367441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a8cef-2267-4d5f-b230-bff47c019e44 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:27:18.372033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:27:18.373171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:27:18.373496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:27:18.373728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] PATH_INFO: `/v3/projects/eecb0bd4d5d1445fa05173fb01055f39` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:27:18.374921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eecb0bd4d5d1445fa05173fb01055f39)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:27:18.377340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:27:18.377340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:27:18.377340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:27:18.377340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:27:18.488490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eecb0bd4d5d1445fa05173fb01055f39', 'request_id': 'req-0d19771d-2fde-443b-9746-9dfb29a30f2d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:18.573625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eecb0bd4d5d1445fa05173fb01055f39', 'request_id': 'req-0d19771d-2fde-443b-9746-9dfb29a30f2d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:18.580208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eecb0bd4d5d1445fa05173fb01055f39', 'request_id': 'req-0d19771d-2fde-443b-9746-9dfb29a30f2d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:18.600093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] The token cache is being invalidate because project eecb0bd4d5d1445fa05173fb01055f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:27:18.600416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:18.601081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0d19771d-2fde-443b-9746-9dfb29a30f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:27:18.602773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 752/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:27:18 2022] DELETE /identity/v3/projects/eecb0bd4d5d1445fa05173fb01055f39 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:27:27.863293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:28.596112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:05.335334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:05.335926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:05.335926 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:05.337284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:05.342409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b938-c3b7-412d-a878-7daeb7e5d174 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:05.342858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b938-c3b7-412d-a878-7daeb7e5d174 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:05.342993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b938-c3b7-412d-a878-7daeb7e5d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:05.361159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c00b938-c3b7-412d-a878-7daeb7e5d174 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:05.362437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c00b938-c3b7-412d-a878-7daeb7e5d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:05.421488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:05.575584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:05.577382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:05.652343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeabe1-e0ed-4283-a340-d9de0c3c4267 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:05.657776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:05.658559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:05.658748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:05.659029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:05.667776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:05.669582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d69a74-5737-4cbf-a241-343aafa3c8f0 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:05.680882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 760/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:06.512501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7bde-3e6f-459e-9fdd-2a0cfd43bf7c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:06.513041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7bde-3e6f-459e-9fdd-2a0cfd43bf7c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:06.513041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7bde-3e6f-459e-9fdd-2a0cfd43bf7c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:06.514414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:06.519346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b400-2f6e-4b77-afb9-436459df6a6a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:06.519738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b400-2f6e-4b77-afb9-436459df6a6a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:06.519922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b400-2f6e-4b77-afb9-436459df6a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:06.540562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a308b400-2f6e-4b77-afb9-436459df6a6a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:06.541779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a308b400-2f6e-4b77-afb9-436459df6a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:06.549823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:06.709688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c7bde-3e6f-459e-9fdd-2a0cfd43bf7c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:06.726053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c7bde-3e6f-459e-9fdd-2a0cfd43bf7c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:06.731950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:06.732803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:06.732969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:06.733249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:06.742770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:06.744369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857070-867d-4c52-b6ff-4cf1ac0fea56 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:06.754831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 755/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:06.780907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5838c-7a35-4eda-bd96-b481f5768665 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:06.781200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5838c-7a35-4eda-bd96-b481f5768665 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:06.781485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5838c-7a35-4eda-bd96-b481f5768665 None None] PATH_INFO: `/v3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:06.782866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 762/1517] 10.222.0.66 () {54 vars in 925 bytes} [Mon Jul 4 09:29:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:29:06.788862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119eaec-b9a6-49f9-a081-78fcde9b72d1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:06.789161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119eaec-b9a6-49f9-a081-78fcde9b72d1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:06.789451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119eaec-b9a6-49f9-a081-78fcde9b72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:06.809634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c119eaec-b9a6-49f9-a081-78fcde9b72d1 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:06.810975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c119eaec-b9a6-49f9-a081-78fcde9b72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:06.885346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 756/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 4 09:29:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:29:10.875398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464f0b-1b6d-4fbe-b147-38fe02f9b49a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:10.875946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464f0b-1b6d-4fbe-b147-38fe02f9b49a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:10.875946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464f0b-1b6d-4fbe-b147-38fe02f9b49a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:10.877285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 763/1519] 10.222.0.61 () {54 vars in 960 bytes} [Mon Jul 4 09:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:10.882579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814002-7922-4837-943d-d7a22578b15b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:10.882997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814002-7922-4837-943d-d7a22578b15b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:10.883145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814002-7922-4837-943d-d7a22578b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:10.902681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6c814002-7922-4837-943d-d7a22578b15b None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:10.903978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c814002-7922-4837-943d-d7a22578b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:10.912842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 757/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Mon Jul 4 09:29:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:10.920932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65464f0b-1b6d-4fbe-b147-38fe02f9b49a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:10.934977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65464f0b-1b6d-4fbe-b147-38fe02f9b49a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:10.939761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:10.940399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:10.940678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:10.940951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:10.949202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:10.950821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fcba3-0036-42f5-93b3-59dcdaa6e585 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:10.960367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 764/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:17.997251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4aa4-9619-4b74-8826-9566af48da5c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:17.997835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4aa4-9619-4b74-8826-9566af48da5c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:17.997835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4aa4-9619-4b74-8826-9566af48da5c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:17.999200 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:18.004206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64649e8d-90a4-41c1-956a-e657738733e9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:18.004724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64649e8d-90a4-41c1-956a-e657738733e9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:18.004828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64649e8d-90a4-41c1-956a-e657738733e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:18.022847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64649e8d-90a4-41c1-956a-e657738733e9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:18.024028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64649e8d-90a4-41c1-956a-e657738733e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:18.032373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:18.187102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa4aa4-9619-4b74-8826-9566af48da5c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:18.202218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa4aa4-9619-4b74-8826-9566af48da5c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:18.207784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:18.208391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:18.208678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:18.208961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:18.217923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:18.219672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ea060-d380-4116-bcaf-764087d6dc33 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:18.230071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 759/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:19.055304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326170-db77-44b9-89fe-6715af7c52ea None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:19.055876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326170-db77-44b9-89fe-6715af7c52ea None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:19.055876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326170-db77-44b9-89fe-6715af7c52ea None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:19.057317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 09:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:19.062249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b8a8b-be04-4837-9101-99e6358fed79 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:19.062675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b8a8b-be04-4837-9101-99e6358fed79 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:19.062830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b8a8b-be04-4837-9101-99e6358fed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:19.080782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-123b8a8b-be04-4837-9101-99e6358fed79 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:19.082033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-123b8a8b-be04-4837-9101-99e6358fed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:19.090452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 09:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:29:19.244027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326170-db77-44b9-89fe-6715af7c52ea None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:19.258678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326170-db77-44b9-89fe-6715af7c52ea None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:19.264523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:19.265179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:19.265455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:19.265733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:19.274090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:19.276390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff339-28b3-4ff4-b332-89cc3a5d5ad5 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:19.285999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 767/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:23.511804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:23.512327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:23.512327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:23.513674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:23.518935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac7f-6a89-4c68-b2ae-9c9b7acd0e39 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:23.519359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac7f-6a89-4c68-b2ae-9c9b7acd0e39 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:23.519505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac7f-6a89-4c68-b2ae-9c9b7acd0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:23.537509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-99deac7f-6a89-4c68-b2ae-9c9b7acd0e39 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:23.538744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99deac7f-6a89-4c68-b2ae-9c9b7acd0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:23.547152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:23.620931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:23.623058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:23.681212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfa30e-068b-4e14-9265-a0d4734e22ae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:23.684737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:23.685381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:23.685670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:23.685950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:23.695823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:23.697256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f6f4-6eff-48bc-acb8-77e28eddb308 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:23.702610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:23.707218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 762/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:25.741491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:25.742081 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:25.742081 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:25.743460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:25.749256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2b8d-e1a1-4eaa-afca-b5299e620d68 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:25.749700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2b8d-e1a1-4eaa-afca-b5299e620d68 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:25.749953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed2b8d-e1a1-4eaa-afca-b5299e620d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:25.768685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b3ed2b8d-e1a1-4eaa-afca-b5299e620d68 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:25.772294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b3ed2b8d-e1a1-4eaa-afca-b5299e620d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:25.778516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:25.816434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:25.818244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:25.831976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406df7-b975-40bb-9237-3fa6d659dc40 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:25.835477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:25.836115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:25.836399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:25.836709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:25.846366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:25.847795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e766a-f508-4527-8a1e-017ae02c0e67 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:25.857359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 770/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:29.351823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:29.352379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:29.352379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:29.353757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:29.359194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c78fb-f250-4523-893b-7ef3a6e6dc1a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:29.359653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c78fb-f250-4523-893b-7ef3a6e6dc1a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:29.361134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c78fb-f250-4523-893b-7ef3a6e6dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:29.366283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=62 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:29.379086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b72c78fb-f250-4523-893b-7ef3a6e6dc1a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:29.383971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b72c78fb-f250-4523-893b-7ef3a6e6dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:29.389328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:29.695590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:29.697335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:29.757683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6235-881e-4205-afdf-6e386bc9b5b8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:29.761343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:29.761990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:29.762316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:29.762597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:29.771621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:29.773116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6533c-732e-4ed5-bb31-c1f335ab9b58 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:29.783027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 765/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:31.896514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:31.897106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:31.897106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:31.898512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 09:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:29:31.903677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514a366-b5c1-4973-bd4e-24d86970d5e9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:31.904083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514a366-b5c1-4973-bd4e-24d86970d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:31.904286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514a366-b5c1-4973-bd4e-24d86970d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:31.923028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7514a366-b5c1-4973-bd4e-24d86970d5e9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:29:31.924244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7514a366-b5c1-4973-bd4e-24d86970d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:31.932789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 09:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:29:32.244474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:29:32.246536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:29:32.259464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67243dba-fa09-47bc-af80-a60c97a8efc9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:29:32.262993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:29:32.263626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:29:32.263913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:29:32.264194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:29:32.273010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:29:32.274459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4b321-71dc-44ac-bfa8-a0f338684468 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:29:32.284405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 773/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:29:41.917600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=32 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:42.280276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:04.734282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:04.735285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:04.735285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:04.780744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:04.782839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:04.793926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 767/1540] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:04.804033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:04.805599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:04.806455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:04.852174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:04.854822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:04.876822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 774/1541] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:04.881575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:04.895432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576872-83ae-41f3-bf74-dfb404327c70 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:04.906595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:04.907581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:04.908156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:04.909246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:04.910223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:04.910760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:04.912797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:04.930517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 768/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:31:04.939389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:04.969239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564988-5cbf-443a-b40e-762f25736194 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:04.984016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:04.985233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:04.985834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:04.986550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:04.987822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:04.996449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.171089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 775/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:04 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:05.183620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:05.196383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd522-32b1-46db-8b4d-2927cd35834c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:05.276432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:05.277043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.277328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.277604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.278333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:05.280776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.373160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 769/1544] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:05 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:05.378404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:05.402318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26957cb-7efa-4659-85d0-825faf945370 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:05.417165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:05.418853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.419602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.420488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.422078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:05.425400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.452517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 776/1545] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:05.458317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:05.474835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f559-6a1e-4f3e-856a-20c3ecaaa8d6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:05.482838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:05.483529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.483810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.484088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.484828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:05.486492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67efdad-fdcf-4b71-a15d-e526fe5b28b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.503993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 770/1546] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:05.511600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:05.536540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab490-45ee-4c87-8d42-fe951c609073 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:05.554344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:05.557013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.557863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.558693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] PATH_INFO: `/v3/projects/c387a0173b804582bcf8547fd703ee10/users/100e3403b088458a802837353cd155ae/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.595116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c387a0173b804582bcf8547fd703ee10, user_id=100e3403b088458a802837353cd155ae, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:05.601178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eee53-8118-49e3-b3e1-5f0bed1a493a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.701769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4203-1f70-4651-aa22-3249ad93612b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.702072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4203-1f70-4651-aa22-3249ad93612b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.702434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4203-1f70-4651-aa22-3249ad93612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.726392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 777/1547] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:05 2022] PUT /identity/v3/projects/c387a0173b804582bcf8547fd703ee10/users/100e3403b088458a802837353cd155ae/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:05.728465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1dcb4203-1f70-4651-aa22-3249ad93612b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:05.729272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dcb4203-1f70-4651-aa22-3249ad93612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:05.760637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92e5-1c3a-4797-a4a9-2edc4914da31 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.761616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92e5-1c3a-4797-a4a9-2edc4914da31 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.762438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92e5-1c3a-4797-a4a9-2edc4914da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.842013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 771/1548] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:05.850954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.851274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.851656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.853588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6cba92e5-1c3a-4797-a4a9-2edc4914da31 None None] MFA Rules not processed for user `100e3403b088458a802837353cd155ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:05.855604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6cba92e5-1c3a-4797-a4a9-2edc4914da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:05.893812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:05.895092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:05.913766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 772/1549] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:05.918771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:05.945036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d4c3-2ccb-46a8-bed5-1d31f43e014c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:05.955141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:05.955835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:05.956123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:05.956992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:05.957124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:05.957443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:05.959103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:05.981704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 773/1550] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:31:05.990747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.008500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643328f9-a6fa-4319-b9bd-d6a4865779e2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.026821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.027425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.027822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.028113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.028931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.029967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:06.029967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:31:06.029967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:31:06.031213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d0cdd-1c1c-4030-ac2b-92ceca14156d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.088070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 778/1551] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.104247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986df47-9691-44de-a284-346009c6ad0c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.104247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986df47-9691-44de-a284-346009c6ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.104247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986df47-9691-44de-a284-346009c6ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.143400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c986df47-9691-44de-a284-346009c6ad0c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.144632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c986df47-9691-44de-a284-346009c6ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.163550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 779/1552] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.164202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986df47-9691-44de-a284-346009c6ad0c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.198910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 774/1553] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:06.200682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd52d-f358-4a71-b259-c12904f8485f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.201168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd52d-f358-4a71-b259-c12904f8485f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.203854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd52d-f358-4a71-b259-c12904f8485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.240395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-61ecd52d-f358-4a71-b259-c12904f8485f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.241580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-61ecd52d-f358-4a71-b259-c12904f8485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.270988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:06.284035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986df47-9691-44de-a284-346009c6ad0c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.322458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:06.360106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 775/1554] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.361486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.362053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.362364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.371665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.372347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.372818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.373107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.385318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.386716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.401706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 776/1555] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.402916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.415624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf9bb-70ab-4425-8ee0-a31431644523 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.421126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.421806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.422436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.422723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.423707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.426214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.437881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.439371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a061f-4cc2-4184-8ed4-8dd1b34d3b0f service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.448773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 780/1556] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:06.452255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3d000-96e2-41e7-80d3-ddcbc5f4e3a6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.452255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3d000-96e2-41e7-80d3-ddcbc5f4e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.452255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3d000-96e2-41e7-80d3-ddcbc5f4e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.470048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fed3d000-96e2-41e7-80d3-ddcbc5f4e3a6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.471293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fed3d000-96e2-41e7-80d3-ddcbc5f4e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.479223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 781/1557] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.484583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6323-854f-4e74-be2a-6a6b8b4d64bb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.484583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6323-854f-4e74-be2a-6a6b8b4d64bb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.484583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6323-854f-4e74-be2a-6a6b8b4d64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.500270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-19cd6323-854f-4e74-be2a-6a6b8b4d64bb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.504003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19cd6323-854f-4e74-be2a-6a6b8b4d64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.514515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 782/1558] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.514515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6f82-bc28-4ed1-8eea-c8409362035f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.514515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6f82-bc28-4ed1-8eea-c8409362035f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.514515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6f82-bc28-4ed1-8eea-c8409362035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.537792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-106d6f82-bc28-4ed1-8eea-c8409362035f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.539028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-106d6f82-bc28-4ed1-8eea-c8409362035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.557951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 783/1559] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.557951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214a22-6da2-41a0-8333-012608969b53 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.557951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214a22-6da2-41a0-8333-012608969b53 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.557951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214a22-6da2-41a0-8333-012608969b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.559983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 777/1560] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:06.562052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.576061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48614086-8943-4c18-afad-8e7b6659fabf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.581193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.581420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-92214a22-6da2-41a0-8333-012608969b53 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.581885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.582176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.582670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.582959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-92214a22-6da2-41a0-8333-012608969b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.583595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:06.583972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.585723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a3a0-82d1-4750-a254-5a00b76c4c08 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.595451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 784/1561] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.595451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819b3d-590b-4e69-b24e-f9208712c347 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.595451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819b3d-590b-4e69-b24e-f9208712c347 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.595451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819b3d-590b-4e69-b24e-f9208712c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.603311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 778/1562] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:06.611875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.611875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.611875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.623066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-28819b3d-590b-4e69-b24e-f9208712c347 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.624307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-28819b3d-590b-4e69-b24e-f9208712c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.628702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.629949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.633166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 785/1563] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.635143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92cc4-30f9-4418-93c4-9bd34da6ea18 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.635508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92cc4-30f9-4418-93c4-9bd34da6ea18 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.635862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92cc4-30f9-4418-93c4-9bd34da6ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.641254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 779/1564] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.641983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.655301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f1b92cc4-30f9-4418-93c4-9bd34da6ea18 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.656627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f1b92cc4-30f9-4418-93c4-9bd34da6ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.663187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ccd64-71f7-4fa8-9079-ca39c95eef7c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.665903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 786/1565] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.667224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba39-1412-4392-9a69-004d16714728 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.667525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba39-1412-4392-9a69-004d16714728 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.667809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba39-1412-4392-9a69-004d16714728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.672753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.673432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.673723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.674000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.674811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.676652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.688708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8586ba39-1412-4392-9a69-004d16714728 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.689093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 780/1566] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:06.690097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8586ba39-1412-4392-9a69-004d16714728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.690461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.699911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 787/1567] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.700792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba39-1412-4392-9a69-004d16714728 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.702442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535645f0-1fb2-4dec-90dd-a8c02c51adb8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.710825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba39-1412-4392-9a69-004d16714728 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.712022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.713144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.713432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.713714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.714621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:06.714947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.715663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.716612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.716906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.717187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.717609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.717911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.719881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7849-4ea7-4767-b980-6f7499c012bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.739884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 781/1568] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:06.739884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.750799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b822e-8642-4e4f-86e5-0b4e3ada276f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.755743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.756443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.756732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.757012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.757747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:06.758241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.760495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.772937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 782/1569] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:06.773727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.783392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6714-8655-4f00-b3e2-a4bbd2e685f0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.788028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.788684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.788971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.789249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.789980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:06.790340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.791943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.804975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 783/1570] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:06.810816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.815649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db52d-74ed-4786-b149-9c5bfea17d7d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.820265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.820895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.821214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.821494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.822878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:06.823190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.824769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.836337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 784/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:06.837206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.847120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805215e3-af3b-4513-a14a-f95b4dda2081 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.852336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.853053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.853346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.853628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.854429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.856059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.863276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 788/1572] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:06.863276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.863276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.863276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.867123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 785/1573] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:06.867784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.882470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82e15-dac2-4e87-9589-6b3bfb98dcbe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.883823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:06.886771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:06.942464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.943166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.943425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.943710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.944433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.946506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:06.951753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 789/1574] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:06.952606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:06.955442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:06.962518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b91b5-f420-4c05-962d-64df52452b11 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:06.967319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:06.971838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:06.971838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:06.971838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:06.971838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:06.971838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.097666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 786/1575] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.098631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.104362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:07.110894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 790/1576] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:06 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.111806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.168865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba53c9-415b-4e18-8d76-f009a15d4839 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.173653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.174499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.175092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.175317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77723188-c85e-483f-9bcf-bc30188e004b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.175493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.176322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.178304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.181999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.182798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.183241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.183601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.184403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.187066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.303708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 787/1577] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.304490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 791/1578] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.304669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.305678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.371460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbd969-3930-4ce8-8f78-1332d907d4a1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.371907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2025c8-e8f6-4c0b-a2fa-0739689ccc45 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.376433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.376573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.377184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.377328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.377478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.377584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.377762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.377882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] PATH_INFO: `/v3/projects/e97e5419f2ca4da6a620c3a0a40ebdf5/users/c0457bc532ce47aeabdec2643f53b4f6/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.378588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.380599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.395322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97e5419f2ca4da6a620c3a0a40ebdf5, user_id=c0457bc532ce47aeabdec2643f53b4f6, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.397994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.485305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 788/1579] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.486367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.498487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a2e9-9ec4-42a2-aa96-a2e6f02db233 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.512048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 792/1580] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:07 2022] PUT /identity/v3/projects/e97e5419f2ca4da6a620c3a0a40ebdf5/users/c0457bc532ce47aeabdec2643f53b4f6/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:07.513451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.514136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.514455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.514730 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.515478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:07.515781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.515928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.517389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.536242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 789/1581] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:07.537939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.553583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601c9d-234c-479b-a8bd-c71aabb42389 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.598028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12755e-2336-412d-9559-1bbd111203bd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.604025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.604688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:07.604869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.605281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.605520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.606249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.609801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:07.609801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:31:07.609801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:31:07.609801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.621096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.621971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.622259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.622548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.623265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.625209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.668344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:07.674591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 793/1582] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.675387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.685783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c1c26-4fb2-44a7-aafa-bce2681322de admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.690574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.695416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.695543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 790/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.695640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.695640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.701686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.701802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.701802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eff3e-bb2b-4ce5-ba33-5489dc1cb10e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.709386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72988fcd-fb33-4472-bb4b-dc6700dc661a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.716164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.717019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.717309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.717590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.718377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.720312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.799778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 791/1584] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.808542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 794/1585] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.808673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.808783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.808783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.808783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.813985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fed7-cbb2-4c46-ab94-9b995ae84cf7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.818936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.819609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.819957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.820199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:07.820308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.820935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.821357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:07.822578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.830085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 795/1586] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:07.830965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.833479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 792/1587] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.838962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.841346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c64e8-e15d-4025-bc52-830f72206ec0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.844368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0bbe-4244-495d-bc10-8124319d9787 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.846169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.846862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.847151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.847494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.848157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.848981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.849643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.849938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.850154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.850287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.850971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.852596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.863716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 793/1588] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.867575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.875172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f9f62-3d5f-4ada-b290-dcf1ac7b0008 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.879804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.880454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.880746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.881027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.881749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.883406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.893628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 794/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.894442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.903840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10c078-f0bf-4d06-929d-525a0cac98a9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.908317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.908942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.909225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.909501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.910226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.911776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.925136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 795/1590] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.925136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.933658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a6a6-2c9b-49c1-8b51-d3ed729754ac admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.938297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.938946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.939237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.939517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.940238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.941873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.952703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 796/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.953880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.966961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ec3-df80-43aa-b5d9-13b91fc5c9f8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:07.971849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:07.972517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:07.975776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 796/1592] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:07.976264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:07.976264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:07.976453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:07.976554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:07.976554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:07.986660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 797/1593] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:07.987968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.000404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c7a4-cc66-4342-9c4f-9481b7ba4e6d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.035254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b044-489b-4876-a1af-3fa6ae6b08f7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.038958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.039605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.039889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.040168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.061005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.061784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.062078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.062395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.063133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.064804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.074769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 798/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:08.076051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.085170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ace44-11c5-44ce-8692-09aa595abeb6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.090508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.091161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.091442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.091720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.092433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.094050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.104110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.105223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 799/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:08.105532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.106008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.115821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 797/1596] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:08.116273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50add80c-4bbe-4118-81c1-630074586ff3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.116640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.121789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.122542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.122896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.123184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.123913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.125542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.126795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906041b2-461e-44f9-8066-284eaf1eb5d2 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.133194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.134118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.134595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.135021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.135906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.139379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 800/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:08.139379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.140159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.148388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583899f-5d78-44e1-8386-af8705ae5a07 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.154558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 798/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:08.154558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.156896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.157680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.158055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.158420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.159185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.161186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.164982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8919-16d0-4914-a32a-88e1419b54c0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.170901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.176882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.176882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.176882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] PATH_INFO: `/v3/projects/0850f366f8c743768011d1c0e0c0e989/users/704a08e8ad3b4070bcd40b84da161538/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.187964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0850f366f8c743768011d1c0e0c0e989, user_id=704a08e8ad3b4070bcd40b84da161538, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.190706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.268869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 801/1599] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:08 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:08.269693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.280533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bafef-f554-4140-bb9f-9c90d71ec2d9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.285382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.286347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.286639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.291611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] PATH_INFO: `/v3/projects/8fc00a591025456585e5adfb93e7bc5a/users/fdc5beed67fc45f588145a525a12e1e4/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.291611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:08.303140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc00a591025456585e5adfb93e7bc5a, user_id=fdc5beed67fc45f588145a525a12e1e4, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.304195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:08.304195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:31:08.304195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:31:08.306291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.308928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 799/1600] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:08 2022] PUT /identity/v3/projects/0850f366f8c743768011d1c0e0c0e989/users/704a08e8ad3b4070bcd40b84da161538/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:08.312682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.339279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:08.371529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ac01-62e7-476e-ae0a-889a2d7f2f5e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.372148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 802/1601] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:08 2022] PUT /identity/v3/projects/8fc00a591025456585e5adfb93e7bc5a/users/fdc5beed67fc45f588145a525a12e1e4/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:08.372999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.440839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.441667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.442020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.442446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] PATH_INFO: `/v3/projects/8f7331c2e53e400c92218d9a894fa356/users/2277ca345bf141eb9cb6b9802aa8fc07/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.451473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b09519-02ef-4ef6-99de-e9876384a2b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.456805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.457993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.458398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.458693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] PATH_INFO: `/v3/projects/3b9d83a830aa4124b42506c9f16d66a4/users/2132cc5c81a14234ae4f96f48d8d35a2/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.464471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7331c2e53e400c92218d9a894fa356, user_id=2277ca345bf141eb9cb6b9802aa8fc07, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.467437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.476532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9d83a830aa4124b42506c9f16d66a4, user_id=2132cc5c81a14234ae4f96f48d8d35a2, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.479454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.578336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 800/1602] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:08 2022] PUT /identity/v3/projects/8f7331c2e53e400c92218d9a894fa356/users/2277ca345bf141eb9cb6b9802aa8fc07/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:08.579059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.594289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 803/1603] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:08 2022] PUT /identity/v3/projects/3b9d83a830aa4124b42506c9f16d66a4/users/2132cc5c81a14234ae4f96f48d8d35a2/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:08.594289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.657404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce6ede-a5be-4f2d-950b-4fafbe4921ce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.694753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa9e99-96dc-486a-87c5-83a9c10b7e16 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.700988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.702442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.702922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.703405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.704507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.707192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2347f4-3192-4235-88d5-cda4232cdf8f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.723590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 804/1604] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:08.726064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebb64-7467-40f1-8a85-35624ee48cbb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.726782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebb64-7467-40f1-8a85-35624ee48cbb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.727580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebb64-7467-40f1-8a85-35624ee48cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.750473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.750473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.750473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.750473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] PATH_INFO: `/v3/projects/66ea879b075a4039a3052d839b43544e/users/e6a16c4c30fc44b997d9eb982985e8c6/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.753063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-be6ebb64-7467-40f1-8a85-35624ee48cbb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:08.755239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be6ebb64-7467-40f1-8a85-35624ee48cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:08.763287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:08.768031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 805/1605] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:08.768031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c06b-ccb0-4505-8c6a-74e5a6c98593 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.768031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c06b-ccb0-4505-8c6a-74e5a6c98593 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.768031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c06b-ccb0-4505-8c6a-74e5a6c98593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.779616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ea879b075a4039a3052d839b43544e, user_id=e6a16c4c30fc44b997d9eb982985e8c6, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.782981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213adfaa-82c6-4075-b375-f0ba892688b4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:08.787354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0259c06b-ccb0-4505-8c6a-74e5a6c98593 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:08.788703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0259c06b-ccb0-4505-8c6a-74e5a6c98593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:08.797977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 806/1606] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:08.801659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.801659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.801659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.830426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] MFA Rules not processed for user `2277ca345bf141eb9cb6b9802aa8fc07`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:08.830426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:08.874529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:08.891536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 801/1607] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:08 2022] PUT /identity/v3/projects/66ea879b075a4039a3052d839b43544e/users/e6a16c4c30fc44b997d9eb982985e8c6/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:08.899147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.899147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.899147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.899947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 807/1608] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:08.900699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:08.912969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749a3ab-5632-4428-8ad5-930afbb3293e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:08.939853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] MFA Rules not processed for user `2132cc5c81a14234ae4f96f48d8d35a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:08.941111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:08.985114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:08.985989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:08.986424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:08.986838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:08.987688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:08.989484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.002365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 808/1609] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:09.003658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.029637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 802/1610] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.030733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.083975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd33b-917a-4bf8-a899-e7da8a2569aa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.089801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.090891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.091522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.091815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.096204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc74d7b-2bfd-4ade-8d7a-ce90de015c96 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.100585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.101638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.102065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.102504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.105766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.107962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edb815-4755-4d88-8ed2-7df4dbf0fee8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.116676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.119170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003dc-9493-498a-a6ad-7c3251a23088 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.119807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 809/1611] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:09.121591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd09ff-1a2c-4118-9eec-3b057c56392b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.121959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd09ff-1a2c-4118-9eec-3b057c56392b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.122339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd09ff-1a2c-4118-9eec-3b057c56392b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.124202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 810/1612] 10.222.0.61 () {54 vars in 961 bytes} [Mon Jul 4 09:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:09.125339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.125633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.125919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.132889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 803/1613] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:09.134490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdf9b-2f76-479e-851a-fb86a47022ed None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.134985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdf9b-2f76-479e-851a-fb86a47022ed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.135682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdf9b-2f76-479e-851a-fb86a47022ed None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.137258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 804/1614] 10.222.0.61 () {54 vars in 961 bytes} [Mon Jul 4 09:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:09.137795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fdf9b-2f76-479e-851a-fb86a47022ed None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.158935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fdf9b-2f76-479e-851a-fb86a47022ed None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.163188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] MFA Rules not processed for user `e6a16c4c30fc44b997d9eb982985e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:09.163188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:09.165952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.167185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.167747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.168194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] PATH_INFO: `/v3/projects/6a218baf28d0416e88cc752284d3d838/users/252b0cfb5934429ba31adc44ee4a556e/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.187308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a218baf28d0416e88cc752284d3d838, user_id=252b0cfb5934429ba31adc44ee4a556e, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.191806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413b02-db05-457c-8334-d54c5006908d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.236508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 811/1615] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.237284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.247912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0eb6f-81fe-4b46-9dd1-227e18bd0d64 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.252843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.253514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.253882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.254247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.254965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.256946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.302178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 805/1616] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:09 2022] PUT /identity/v3/projects/6a218baf28d0416e88cc752284d3d838/users/252b0cfb5934429ba31adc44ee4a556e/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:09.303587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40592-6dfe-41a0-9f16-d6f52ecdbf8e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.304045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40592-6dfe-41a0-9f16-d6f52ecdbf8e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.304330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40592-6dfe-41a0-9f16-d6f52ecdbf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.324109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-12e40592-6dfe-41a0-9f16-d6f52ecdbf8e None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:09.325344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-12e40592-6dfe-41a0-9f16-d6f52ecdbf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:09.379945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:09.402529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 806/1617] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.403727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2356-67b0-4f96-a255-f3c2bec7f68a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.403947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2356-67b0-4f96-a255-f3c2bec7f68a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.404227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2356-67b0-4f96-a255-f3c2bec7f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.410759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 812/1618] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/projects => generated 405 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:09.412090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.424064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-32bb2356-67b0-4f96-a255-f3c2bec7f68a None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:09.425286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32bb2356-67b0-4f96-a255-f3c2bec7f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:09.495703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1a91-951d-42f6-963c-84a8f16b2071 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.502279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.503131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.503467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.504224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.505274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.507822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.525585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 807/1619] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.527162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870013-f7c1-4a6b-aa2d-7afa242c4f09 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.527513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870013-f7c1-4a6b-aa2d-7afa242c4f09 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.527925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870013-f7c1-4a6b-aa2d-7afa242c4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.549111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-25870013-f7c1-4a6b-aa2d-7afa242c4f09 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:09.552818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-25870013-f7c1-4a6b-aa2d-7afa242c4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:09.559641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 808/1620] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.561019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efece11-c4a3-4da0-85ec-950ba034076b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.561323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efece11-c4a3-4da0-85ec-950ba034076b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.561607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efece11-c4a3-4da0-85ec-950ba034076b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.568566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 809/1621] 10.222.0.61 () {54 vars in 912 bytes} [Mon Jul 4 09:31:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:09.569269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efece11-c4a3-4da0-85ec-950ba034076b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.583110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efece11-c4a3-4da0-85ec-950ba034076b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.591279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.592030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.600231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.600231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.600231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.600231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.636015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 813/1622] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:09.638967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.712584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:09.718709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 810/1623] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/users => generated 309 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:09.720007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:09.732381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1b81-ab32-4115-98c7-bbcdbac83d7d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.740669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.741643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.741936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.742330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.804327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78fb48-1c22-46a4-846c-4071c1754a8b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:09.823638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:09.825321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c2c86-238d-4154-a6a5-534d7a869f66 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:09.835082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 814/1624] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:09.836221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.836513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.836800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.889825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:09.891090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:09.910964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:09.911643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:09.911930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:09.912215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:09.916784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 815/1625] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:09.917688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.016392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:10.035725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f80386-39d5-4b8a-b7b4-07b066906d5b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.050268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.050983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.051274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.052570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.052831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.054837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.056910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.059606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.077629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 811/1626] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:10.080164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.099254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:10.103691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d052d-e072-4d8c-aded-1778cc4090e6 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.114689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.114689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.114689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.114689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.115323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.115323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.130355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 812/1627] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:10.130971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.167478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 816/1628] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:09 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:10.172667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.191529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82213-a6ec-48c0-8540-2953d2bba9d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.202622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.204116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.204782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.205173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] PATH_INFO: `/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5/users/5986632267e8425eac95fea635fe971f/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.227109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14197b9f-a87c-4508-bfd0-173ffbcd5fe1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.235144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.235840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.236129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.236465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.240557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3bc12fe2d748548c5d56e0c82b89d5, user_id=5986632267e8425eac95fea635fe971f, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.244538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.260272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.262647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.281805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 813/1629] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:10.283237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.301255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae44bf-23c6-4b25-bd74-c0e634a3bb7f service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.308886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.312302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.312302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.312302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.312302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.314740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22d10-8280-4e93-8959-2ebf39b2bbea admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.335468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 814/1630] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:10.339306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac856-c4c7-46d4-9c69-846c11cd7b42 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.339695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac856-c4c7-46d4-9c69-846c11cd7b42 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.344318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 817/1631] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:10 2022] PUT /identity/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5/users/5986632267e8425eac95fea635fe971f/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:10.344318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.344545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac856-c4c7-46d4-9c69-846c11cd7b42 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.344545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 815/1632] 10.222.0.61 () {54 vars in 912 bytes} [Mon Jul 4 09:31:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:10.347061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac856-c4c7-46d4-9c69-846c11cd7b42 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.451335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fffc2-69e2-44da-9d15-0deb26e955cb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.466774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.467700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.467990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.468273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] PATH_INFO: `/v3/projects/38951a91beaf4888be968200185d1cc5/users/edbe5153da364d3fb2ee6ad22aa4a0da/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.484069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac856-c4c7-46d4-9c69-846c11cd7b42 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.491862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38951a91beaf4888be968200185d1cc5, user_id=edbe5153da364d3fb2ee6ad22aa4a0da, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.492604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.493567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.493864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.494351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.495363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.495685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.497640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7712cc0-6d0c-4d6e-8bfd-86887ce64daf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.510905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 816/1633] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:10.512575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.512870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.513329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.535876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:10.537164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:10.621620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 818/1634] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:10 2022] PUT /identity/v3/projects/38951a91beaf4888be968200185d1cc5/users/edbe5153da364d3fb2ee6ad22aa4a0da/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:10.621620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.695646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 817/1635] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:10.697460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.725191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84122293-68b3-4e20-9152-5c70d8ee734b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.769826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160797e4-bed8-44b6-ab1d-e2c9431cf7cd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.775493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.776928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.777555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.778073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] PATH_INFO: `/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5/users/5986632267e8425eac95fea635fe971f/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.783570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:10.785431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3bc12fe2d748548c5d56e0c82b89d5, user_id=5986632267e8425eac95fea635fe971f, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.789959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.814274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 819/1636] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:10 2022] PUT /identity/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5/users/5986632267e8425eac95fea635fe971f/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:10.814274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:10.834539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.836130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.836469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.836753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.837854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:10.839838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e6a75-51a3-4432-98a8-f6ef4a0d5ac5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:10.857850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 818/1637] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:10.859392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.859729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.860345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.881076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931e0e-ca95-4f65-8fe5-10087618a27f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:10.886886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:10.887718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:10.888669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:10.888669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:10.889151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] MFA Rules not processed for user `5986632267e8425eac95fea635fe971f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:10.890447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:10.994554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:11.000265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:11.001890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:11.019861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 820/1638] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:11.020893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:11.056440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 819/1639] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:11.126732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58557-12ab-44cf-8ae6-2ac80cedea78 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:11.176342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:11.180346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:11.180710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:11.181006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] PATH_INFO: `/v3/projects/38951a91beaf4888be968200185d1cc5/users/edbe5153da364d3fb2ee6ad22aa4a0da/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:11.194947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38951a91beaf4888be968200185d1cc5, user_id=edbe5153da364d3fb2ee6ad22aa4a0da, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:11.195693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0e056-ad0e-44ba-8166-98e656031729 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:11.201491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:11.218259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f48d6c-1f93-4b5b-9972-056b7b767eb5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:11.359957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:11.359957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:11.359957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:11.359957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:11.383475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 821/1640] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:11 2022] PUT /identity/v3/projects/38951a91beaf4888be968200185d1cc5/users/edbe5153da364d3fb2ee6ad22aa4a0da/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:11.383475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:11.383475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:11.383475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:11.384283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:11.384283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:11.384283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 820/1641] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:11.384603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] MFA Rules not processed for user `edbe5153da364d3fb2ee6ad22aa4a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:11.384603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:11.533368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 822/1642] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:12.124578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:12.124578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcaaa4-e00e-4ba0-8075-40f8ca293905 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:12.124578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:12.124578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f421e-b93c-419c-ae90-7442903494bd service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:12.128927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 821/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:12.387326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:12.903045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:13.022471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01e1a-c883-44a8-a186-5347dd7a05cd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:13.032593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:13.036623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:13.037014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:13.037313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] PATH_INFO: `/v3/users/2132cc5c81a14234ae4f96f48d8d35a2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:13.042935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2132cc5c81a14234ae4f96f48d8d35a2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:13.044574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:13.044574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 04 09:31:13.044574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: Jul 04 09:31:13.048689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:13.352138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2132cc5c81a14234ae4f96f48d8d35a2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:13.354570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2132cc5c81a14234ae4f96f48d8d35a2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:13.357723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2132cc5c81a14234ae4f96f48d8d35a2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:13.401523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2132cc5c81a14234ae4f96f48d8d35a2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:14.016449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2132cc5c81a14234ae4f96f48d8d35a2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:14.053660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 823/1644] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:12 2022] DELETE /identity/v3/users/2132cc5c81a14234ae4f96f48d8d35a2 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:14.061921 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:14.061921 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:14.061921 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:14.081276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:14.085714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:14.209902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 822/1645] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:14.223310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:14.224857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:14.336673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985483-6373-4192-b7e1-3aa27e50fd53 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:14.346737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:14.349574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:14.350024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:14.350671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:14.427212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:14.428701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:14.482563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 824/1646] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:14.616905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:15.462167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:15.468173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:15.576445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:15.578778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:15.593835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027834-0b79-4203-bbb3-cbf9eedef509 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:15.606412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:15.606412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:15.606412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:15.606412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:15.606801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce720ac-321e-4b16-974f-c9a7bec183b7 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:15.620773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:15.620773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:15.621145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:15.621223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:15.621223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] PATH_INFO: `/v3/projects/3b9d83a830aa4124b42506c9f16d66a4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:15.626468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9d83a830aa4124b42506c9f16d66a4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:15.628451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:15.745328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:15.771844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:15.773492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:15.790793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 823/1647] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:15.847720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9d83a830aa4124b42506c9f16d66a4', 'request_id': 'req-6f665040-d5db-4260-a0b6-018c28c7b82f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:15.953306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9d83a830aa4124b42506c9f16d66a4', 'request_id': 'req-6f665040-d5db-4260-a0b6-018c28c7b82f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:15.964822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9d83a830aa4124b42506c9f16d66a4', 'request_id': 'req-6f665040-d5db-4260-a0b6-018c28c7b82f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.010569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:16.013417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:16.014716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] The token cache is being invalidate because project 3b9d83a830aa4124b42506c9f16d66a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:16.015233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.018388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.025768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 825/1648] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:15 2022] DELETE /identity/v3/projects/3b9d83a830aa4124b42506c9f16d66a4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:16.026983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:16.033214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:16.042817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203d366-42fc-4666-b760-622df714b8de service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:16.208832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665040-d5db-4260-a0b6-018c28c7b82f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:16.222812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:16.228439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:16.228439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:16.228439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] PATH_INFO: `/v3/users/5986632267e8425eac95fea635fe971f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:16.231146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5986632267e8425eac95fea635fe971f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:16.235617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:16.257347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:16.258474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:16.258897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:16.262742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] PATH_INFO: `/v3/users/2277ca345bf141eb9cb6b9802aa8fc07` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:16.266797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2277ca345bf141eb9cb6b9802aa8fc07)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:16.269033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:16.501809 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5986632267e8425eac95fea635fe971f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.503281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5986632267e8425eac95fea635fe971f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.504595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5986632267e8425eac95fea635fe971f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.514898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:16.517820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2277ca345bf141eb9cb6b9802aa8fc07'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.518845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2277ca345bf141eb9cb6b9802aa8fc07'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.545461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5986632267e8425eac95fea635fe971f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.605468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2277ca345bf141eb9cb6b9802aa8fc07'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.616058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2277ca345bf141eb9cb6b9802aa8fc07'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.629835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8b8e70e8-9e19-4018-801e-d54e174ce1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2277ca345bf141eb9cb6b9802aa8fc07'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.656224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5986632267e8425eac95fea635fe971f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:16.665949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 824/1649] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:16 2022] DELETE /identity/v3/users/2277ca345bf141eb9cb6b9802aa8fc07 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:16.670532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758047-796e-49b3-9642-b9417f45757a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:16.671170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758047-796e-49b3-9642-b9417f45757a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:16.671670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758047-796e-49b3-9642-b9417f45757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:16.689188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 826/1650] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:16 2022] DELETE /identity/v3/users/5986632267e8425eac95fea635fe971f => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:16.701061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c0758047-796e-49b3-9642-b9417f45757a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:16.707590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c0758047-796e-49b3-9642-b9417f45757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:16.833332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 825/1651] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:16.873751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:16.875448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:16.975521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6b78a-677f-4004-b74e-38efc3932650 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:16.980273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:16.982719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:16.983201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:16.983727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:17.003263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:17.009227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5a618-9c16-417b-b317-71c5c0971dd1 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:17.021284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 827/1652] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:18.431871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758047-796e-49b3-9642-b9417f45757a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:18.435298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c0758047-796e-49b3-9642-b9417f45757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:18.465343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:18.466803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758047-796e-49b3-9642-b9417f45757a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:18.480072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:18.481047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:18.483847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:18.484405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] PATH_INFO: `/v3/projects/8f7331c2e53e400c92218d9a894fa356` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:18.488060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7331c2e53e400c92218d9a894fa356)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:18.492084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:18.492084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:31:18.492084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:31:18.497363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:18.722839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7331c2e53e400c92218d9a894fa356', 'request_id': 'req-a205a3de-9884-4f0c-b4bd-a8676472ee1d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:18.805563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7331c2e53e400c92218d9a894fa356', 'request_id': 'req-a205a3de-9884-4f0c-b4bd-a8676472ee1d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:18.834660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7331c2e53e400c92218d9a894fa356', 'request_id': 'req-a205a3de-9884-4f0c-b4bd-a8676472ee1d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:18.880655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] The token cache is being invalidate because project 8f7331c2e53e400c92218d9a894fa356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:18.892475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:18.897116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:18.903544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 826/1653] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:18 2022] DELETE /identity/v3/projects/8f7331c2e53e400c92218d9a894fa356 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:18.911082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c31f4-d1f6-4163-9baa-4101bc50f980 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:18.911082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c31f4-d1f6-4163-9baa-4101bc50f980 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:18.911082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c31f4-d1f6-4163-9baa-4101bc50f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:18.913865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:18.923331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:18.971273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f09c31f4-d1f6-4163-9baa-4101bc50f980 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:18.972921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f09c31f4-d1f6-4163-9baa-4101bc50f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:19.153290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a3de-9884-4f0c-b4bd-a8676472ee1d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.159329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 828/1654] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:19.171793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.172391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.172681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.172963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] PATH_INFO: `/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.174680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3bc12fe2d748548c5d56e0c82b89d5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.175787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.176279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.176720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.199449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.220887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:19.223071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:19.255960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 829/1655] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:19.257404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:19.275720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e43b-3956-456f-ae40-b03cbde8a185 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.285469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.286625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.287243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.287676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.288627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:19.289150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.296777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.327968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 830/1656] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:19.330561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:19.356884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e9b6b-b893-4284-8e54-a1a814b49e0d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.373553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3bc12fe2d748548c5d56e0c82b89d5', 'request_id': 'req-ee9164c2-4ab0-476c-8b13-71e31c73f06f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:19.450472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3bc12fe2d748548c5d56e0c82b89d5', 'request_id': 'req-ee9164c2-4ab0-476c-8b13-71e31c73f06f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:19.462628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3bc12fe2d748548c5d56e0c82b89d5', 'request_id': 'req-ee9164c2-4ab0-476c-8b13-71e31c73f06f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:19.492479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:19.497630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] The token cache is being invalidate because project 5c3bc12fe2d748548c5d56e0c82b89d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:19.497630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:19.498993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ee9164c2-4ab0-476c-8b13-71e31c73f06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:19.505422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 827/1657] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:18 2022] DELETE /identity/v3/projects/5c3bc12fe2d748548c5d56e0c82b89d5 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:19.507971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74247-2234-4149-88d8-a1c105a05b89 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.508314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74247-2234-4149-88d8-a1c105a05b89 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.508577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74247-2234-4149-88d8-a1c105a05b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.512078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.512766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.513049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.513725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.516283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.519483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.555305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-63a74247-2234-4149-88d8-a1c105a05b89 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:19.556838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-63a74247-2234-4149-88d8-a1c105a05b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:19.579403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 828/1658] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:19.580951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.583156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.583156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.612666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:19.616884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:19.644068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 829/1659] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:19.651496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:19.689020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 831/1660] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/projects => generated 369 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:19.691017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b6b8-6da8-4c4e-880d-e60647d566b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.693864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:19.699028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:19.835779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.837317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.837666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.837954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.841728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:19.842389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.844563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:31:19.844563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: warnings.warn(msg) Jul 04 09:31:19.844563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: Jul 04 09:31:19.845574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.863616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814e9c0-8e0b-419b-bee0-857873b8fa2b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.882814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.883562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.883851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.884143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.884832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.889805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.895462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 830/1661] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:19.900046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:19.924011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f329-0b9c-43af-abb9-ab0476d60b52 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:19.942470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:19.943391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:19.943783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:19.944189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:19.950293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:19.961063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:19.989695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 832/1662] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/users => generated 285 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:19.993563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.017279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672b1f-5e3f-48cb-aaa2-13274b05b842 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.033806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.034556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.034840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.035118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.036018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.038098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.063050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 833/1663] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:20.071997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.082969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 831/1664] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:19 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:20.084175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.097340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798039b-be54-4340-88f8-da188271d98b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.243655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:20.282518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c803-0f6d-4118-9276-0984d0721bdb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.291789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.293782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.294101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.294412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.299133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.309682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.326515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.327428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.327545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.327750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.328490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.330178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.357415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 834/1665] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:20.361932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.385669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e63f-0914-47d6-8779-94b7439d49d6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.404439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.404590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.405081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.405191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] PATH_INFO: `/v3/projects/36182b81e82e4e32b6c00967e8cf32fe/users/358c172e3da947c1a2ef89a375c212f6/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.435185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36182b81e82e4e32b6c00967e8cf32fe, user_id=358c172e3da947c1a2ef89a375c212f6, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.439806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 832/1666] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:20 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:20.439977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979982-26ce-4d80-857e-7c0e83f1e51a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.441339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.460771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde43a6-1a9c-4966-bc76-f156062e3e79 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.480803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.481636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.483554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.483554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.483554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.489805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.524297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 833/1667] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:20.525920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.546845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282d8e0-ed1c-4881-959f-43181ba9272c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.562903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 835/1668] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:20 2022] PUT /identity/v3/projects/36182b81e82e4e32b6c00967e8cf32fe/users/358c172e3da947c1a2ef89a375c212f6/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:20.563072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.565155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.566914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.567297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.568748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.574749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.574977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.575261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.588202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.623147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 834/1669] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:20.624331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.646695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045efb5-aaff-4a8c-8f9a-bf105478e1ba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.653476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] MFA Rules not processed for user `358c172e3da947c1a2ef89a375c212f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:20.655629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:20.773154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.774103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.774445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.774728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] PATH_INFO: `/v3/projects/d96dee2c4f814bcc9fc99e7e7ebbb924/users/5c67a0c7d62b493db64798fe8a135da4/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.787107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 836/1670] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:20.794063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:20.808121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96dee2c4f814bcc9fc99e7e7ebbb924, user_id=5c67a0c7d62b493db64798fe8a135da4, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.811114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba42b2b-1ad3-44e2-a0dd-0c104f92fd6b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:20.818900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7effc0-7a8c-465f-bc10-be6ed9e7cab1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:20.826831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:20.827517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:20.827804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:20.828139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:20.829883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:20.831916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.001373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 835/1671] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:20 2022] PUT /identity/v3/projects/d96dee2c4f814bcc9fc99e7e7ebbb924/users/5c67a0c7d62b493db64798fe8a135da4/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:21.006941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.007980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 837/1672] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:20 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:21.013272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.014175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.017934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.184543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] MFA Rules not processed for user `5c67a0c7d62b493db64798fe8a135da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:21.196525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:21.268384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377937-fd55-416e-82b9-6ccc2aeeeeff admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:21.287659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:21.288505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.288803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.289087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.290376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:21.292336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:21.294781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.404754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 836/1673] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:21.404754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.404754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:21.416122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f56ba-1df4-498b-8ff7-0ea34c4d898b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:21.426914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:21.427830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.428118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.428400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] PATH_INFO: `/v3/users/e6a16c4c30fc44b997d9eb982985e8c6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.429703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a16c4c30fc44b997d9eb982985e8c6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:21.432780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.478858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 838/1674] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:21 2022] POST /identity/v3/users => generated 291 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:21.480023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.505636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f5c-27f8-4a53-88bc-3c4a079e7480 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:21.514392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:21.515135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.515507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.523945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.523945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:21.523945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.635384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 839/1675] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:21 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:21.638402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.784526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a16c4c30fc44b997d9eb982985e8c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:21.789521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a16c4c30fc44b997d9eb982985e8c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:21.866815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29578-19b7-494d-b02c-92326c0e5d3e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:21.880361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:21.881065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.881355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.881636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.882412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:21.887113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.915515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a16c4c30fc44b997d9eb982985e8c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:21.916235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 840/1676] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:21.916235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.916235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:21.923392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a16c4c30fc44b997d9eb982985e8c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:21.924395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a16c4c30fc44b997d9eb982985e8c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:21.948457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a281-8b9c-47c0-9ad7-1fb8b6c8f8cb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:21.955045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:21.956423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:21.956925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:21.957448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:21.959171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:21.963140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acdf28-2501-419d-b3f9-5fd08e8e563f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:21.979148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 837/1677] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:21 2022] DELETE /identity/v3/users/e6a16c4c30fc44b997d9eb982985e8c6 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:21.980458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:21.984062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.085589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 841/1678] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:21 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:22.087754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.088279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.089338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.103732 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db553fe3-427e-4ada-a3e2-0ef7c3d576bc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:22.115993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:22.118187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.118743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.121080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] PATH_INFO: `/v3/users/100e3403b088458a802837353cd155ae` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.123084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=100e3403b088458a802837353cd155ae)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:22.125378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:22.176989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:22.340290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100e3403b088458a802837353cd155ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:22.342679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100e3403b088458a802837353cd155ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:22.363567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] MFA Rules not processed for user `c0457bc532ce47aeabdec2643f53b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:22.365691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.413348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100e3403b088458a802837353cd155ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:22.424384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100e3403b088458a802837353cd155ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:22.425718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-27904b77-d00f-4cb9-b83c-5ea607d6b22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100e3403b088458a802837353cd155ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:22.462831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 842/1679] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:22.464150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:22.466687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.491064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 838/1680] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:21 2022] DELETE /identity/v3/users/100e3403b088458a802837353cd155ae => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:22.491064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.491589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.492215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.500510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535abe3-4c86-4d3e-ab82-3a1bec97dbe7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:22.505201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:22.524441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:22.527009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.577530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:22.578831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.579115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.579404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] PATH_INFO: `/v3/projects/cbf16d879b5045eabaa2eec05e0801b2/users/299528117a1a41b49961fb736d71262c/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.625442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf16d879b5045eabaa2eec05e0801b2, user_id=299528117a1a41b49961fb736d71262c, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:22.631205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:22.666574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 839/1681] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:22.667598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:22.669470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.692543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569af1f-57fa-4d92-863a-e5a71cedd4a6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:22.700120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:22.701639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.701935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.702240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.703036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:22.705193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243683-d392-4994-ba62-1e2d571f550c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:22.713816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 843/1682] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:22 2022] PUT /identity/v3/projects/cbf16d879b5045eabaa2eec05e0801b2/users/299528117a1a41b49961fb736d71262c/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:22.717698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:22.720250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.733886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 840/1683] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:22.733886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:22.733886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:22.733886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:22.780489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:22.784053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:22.983196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:22.987041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649521c0-3fbf-4c11-89fc-320354a9ad7c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.000490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.003689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.004146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.004536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.035654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 841/1684] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:23.036693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.038142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:23.152334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.154591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.185170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 844/1685] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:23.185170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.218310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18145-1921-42df-a5fe-3ca8e6b16997 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.229154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265d15-213e-4ecd-b90c-7ab9eb6b7851 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.237043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.237734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.238022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.239053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.239755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.240043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.240327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.240570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.241079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.242980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.274996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.278739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.282033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 845/1686] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:23.282033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.311661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e65e-5224-4bb3-9c4e-dfa5d0389eb7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.316363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 842/1687] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:23.318075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.330934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.331913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.332204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.332588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] PATH_INFO: `/v3/projects/f955220eab934b989b92602ce64e6280/users/a8ba250337554efb9a09283dceb7c8e6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.336077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2233-c311-4ccf-91f0-e6f40ff89e13 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.357167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.357167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.357167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.357167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.358860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:23.371147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.382797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f955220eab934b989b92602ce64e6280, user_id=a8ba250337554efb9a09283dceb7c8e6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.382995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.392214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.400851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 843/1688] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:23.402464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.427445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f341-edde-4530-8c22-c3285d6b6408 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.451174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.452305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.452693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.453084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] PATH_INFO: `/v3/projects/cbf16d879b5045eabaa2eec05e0801b2/users/299528117a1a41b49961fb736d71262c/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.457370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf16d879b5045eabaa2eec05e0801b2, user_id=299528117a1a41b49961fb736d71262c, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.464876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181e4f-e104-4894-a4c8-74f7b0ee5906 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.472357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 846/1689] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:23 2022] PUT /identity/v3/projects/f955220eab934b989b92602ce64e6280/users/a8ba250337554efb9a09283dceb7c8e6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:23.473379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.499726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 844/1690] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:23 2022] PUT /identity/v3/projects/cbf16d879b5045eabaa2eec05e0801b2/users/299528117a1a41b49961fb736d71262c/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:23.504918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.505400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.505762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.583283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] MFA Rules not processed for user `299528117a1a41b49961fb736d71262c`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:23.587129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:23.652477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56a1d-eed7-452d-b66e-5b3dc73e7342 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.796820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 845/1691] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:23.808626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.810465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:23.812063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.812855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.813142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.813420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.816094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.823562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.847283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 847/1692] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:23.853755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:23.883554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675564-9ac1-49ec-a8d9-a1ddb1b8a6ac admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:23.901967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:23.912880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.913208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.913453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] PATH_INFO: `/v3/projects/f955220eab934b989b92602ce64e6280/users/a8ba250337554efb9a09283dceb7c8e6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:23.931022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f955220eab934b989b92602ce64e6280, user_id=a8ba250337554efb9a09283dceb7c8e6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:23.931022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0537-2093-47f6-a65d-73f358fd4f01 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:23.969935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 848/1693] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:23 2022] PUT /identity/v3/projects/f955220eab934b989b92602ce64e6280/users/a8ba250337554efb9a09283dceb7c8e6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:23.972821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e373-354f-4fb7-97b1-6af53ad859aa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:23.972821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e373-354f-4fb7-97b1-6af53ad859aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:23.972821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e373-354f-4fb7-97b1-6af53ad859aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.017596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da2910-3e24-4a93-86b3-21c6ff5f4cd2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:24.036433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e7b4e373-354f-4fb7-97b1-6af53ad859aa None None] MFA Rules not processed for user `fdc5beed67fc45f588145a525a12e1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:24.037769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7b4e373-354f-4fb7-97b1-6af53ad859aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:24.182177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:24.183045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:24.183337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:24.183615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.207262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 849/1694] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:24.208934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:24.209372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:24.209742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.284718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:24.310503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:24.317215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] MFA Rules not processed for user `a8ba250337554efb9a09283dceb7c8e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:24.318491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:24.380157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:24.381468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:24.427207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 846/1695] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:24.427207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:24.427207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:24.588664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 850/1696] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:24.599943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:24.601403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:24.622292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a69ea-6b36-48dd-a8d8-a463b7aa5921 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:24.629450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:24.634064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:24.634064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:24.634064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.641368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31ac9-2b50-49a1-8a4e-4b6eb8b6d903 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:24.653168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:24.656408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:24.670944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:24.671165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:24.671445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:24.671727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.676576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 851/1697] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:24.707844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:24.709478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:24.774817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 847/1698] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:24.894772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:24.904940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b89d4-e159-46eb-9441-d16f98d3268c service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:24.927865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:24.928560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:24.928841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:24.929122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:24.945327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:25.035713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:25.037767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:25.169998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:25.173677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6343a3b-5955-46eb-9926-fb41a8c18b47 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:25.208874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 852/1699] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:25.258109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b10d0e-1fef-42c0-9b67-57d9f082900b service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:25.270613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:25.271751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:25.272181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:25.274159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] PATH_INFO: `/v3/projects/66ea879b075a4039a3052d839b43544e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:25.289062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ea879b075a4039a3052d839b43544e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:25.295419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:25.342332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:25.498091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ea879b075a4039a3052d839b43544e', 'request_id': 'req-c7b88a22-5d52-49db-8288-467f2affccbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:25.523868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:25.524166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:25.524602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:25.587780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ea879b075a4039a3052d839b43544e', 'request_id': 'req-c7b88a22-5d52-49db-8288-467f2affccbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:25.588143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] MFA Rules not processed for user `252b0cfb5934429ba31adc44ee4a556e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:25.594968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:25.595213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ea879b075a4039a3052d839b43544e', 'request_id': 'req-c7b88a22-5d52-49db-8288-467f2affccbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:25.635575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] The token cache is being invalidate because project 66ea879b075a4039a3052d839b43544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:25.635856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:25.637291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:25.641375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 848/1700] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:25 2022] DELETE /identity/v3/projects/66ea879b075a4039a3052d839b43544e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:25.646504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:25.650005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:25.778331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 853/1701] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:25.780175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:25.782485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:25.800653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adda619-47fa-435f-94a8-ac146f47aff4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:25.802908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b88a22-5d52-49db-8288-467f2affccbc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:25.813570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:25.814791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:25.815272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:25.815726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] PATH_INFO: `/v3/users/edbe5153da364d3fb2ee6ad22aa4a0da` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:25.817360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbe5153da364d3fb2ee6ad22aa4a0da)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:25.819853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:25.834172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:25.835080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:25.835367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:25.840881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] PATH_INFO: `/v3/projects/c387a0173b804582bcf8547fd703ee10` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:25.844594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c387a0173b804582bcf8547fd703ee10)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:25.855588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:26.123800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbe5153da364d3fb2ee6ad22aa4a0da'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.126733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbe5153da364d3fb2ee6ad22aa4a0da'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.134492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c387a0173b804582bcf8547fd703ee10', 'request_id': 'req-a58ca490-7308-4b1d-ad59-923fa5edfc8b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.230487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbe5153da364d3fb2ee6ad22aa4a0da'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.260494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbe5153da364d3fb2ee6ad22aa4a0da'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.279050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fa962ac-6b1d-4c91-8a51-b2cd2d9c5d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbe5153da364d3fb2ee6ad22aa4a0da'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.291452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:26.297274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c387a0173b804582bcf8547fd703ee10', 'request_id': 'req-a58ca490-7308-4b1d-ad59-923fa5edfc8b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.300481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c387a0173b804582bcf8547fd703ee10', 'request_id': 'req-a58ca490-7308-4b1d-ad59-923fa5edfc8b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.344081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] The token cache is being invalidate because project c387a0173b804582bcf8547fd703ee10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:26.347060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.350395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:26.359189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 854/1702] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:25 2022] DELETE /identity/v3/projects/c387a0173b804582bcf8547fd703ee10 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:26.360997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:26.363501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:26.384079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 849/1703] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:25 2022] DELETE /identity/v3/users/edbe5153da364d3fb2ee6ad22aa4a0da => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:26.392200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb37-8fe1-43d9-a8ee-5632de95249f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:26.394186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb37-8fe1-43d9-a8ee-5632de95249f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:26.400242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb37-8fe1-43d9-a8ee-5632de95249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:26.443946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2847bb37-8fe1-43d9-a8ee-5632de95249f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:26.445238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2847bb37-8fe1-43d9-a8ee-5632de95249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:26.569018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ca490-7308-4b1d-ad59-923fa5edfc8b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:26.687912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 850/1704] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:26.696732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:26.699370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:26.702078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:26.702078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:26.759674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:26.761421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:26.799554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 851/1705] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:26.801575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:26.802253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:26.802666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:26.803064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:26.808509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:26.810433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:26.829503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100f6e1-dd1d-4edb-8bcb-4d4c7cadccc0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:26.845443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:26.846370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:26.846664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:26.846952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:26.847714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:26.849068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:26.854685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:26.874756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 852/1706] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:26.886665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:26.914748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5a79b-3a29-4d59-a192-da6199eb3624 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:26.934097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:26.935126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:26.935750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:26.942617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:26.942617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:26.942617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.023214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.026052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5199-4abb-4176-8c90-e1e82fd793d9 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.086613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 855/1707] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:27.094121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ae93-6e95-4e0d-9874-dc87cd8345e5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.094121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ae93-6e95-4e0d-9874-dc87cd8345e5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.094121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ae93-6e95-4e0d-9874-dc87cd8345e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.094358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 853/1708] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:26 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:27.095760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.180581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a382ae93-6e95-4e0d-9874-dc87cd8345e5 None None] MFA Rules not processed for user `704a08e8ad3b4070bcd40b84da161538`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:27.182301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a382ae93-6e95-4e0d-9874-dc87cd8345e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:27.299250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8681559-c23b-4a1b-9d43-b154535ed683 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.323697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:27.324405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.324684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.325472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.328163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.331886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.358931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 856/1709] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:27.373457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.374547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.375009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.457389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] MFA Rules not processed for user `704a08e8ad3b4070bcd40b84da161538`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:27.458573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:27.480069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 854/1710] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:27 2022] POST /identity/v3/users => generated 288 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:27.482118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.495933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 857/1711] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:27.513408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.514796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:27.517403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481f2e-c1cc-4c37-acdd-7fc5367b3e99 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.532646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:27.544065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.545181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.545663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.547181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.551917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.589602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 855/1712] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:27.596201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.631317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc93d34-9428-465a-8212-8887d9404db1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.633489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:27.642961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:27.649170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.649862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.650590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.651629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.655339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.687688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 856/1713] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:27.694634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.723571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03884c61-f843-4f6f-b969-ba291e28ea75 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.738231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:27.739611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.739611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.741706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] PATH_INFO: `/v3/projects/706987cd4b6945ecab479f99f98fa11b/users/2056aeb18c834de29e1125066b355bb7/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.765260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeadc5-c57d-4d22-a973-65714bda29e3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.783720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] RBAC: Authorizing `identity:create_grant(project_id=706987cd4b6945ecab479f99f98fa11b, user_id=2056aeb18c834de29e1125066b355bb7, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.787467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:27.791397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.792938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d9bb-2aa9-49e2-9011-b82d02dc064b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.793254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.793536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.811430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:27.816764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:27.858643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 858/1714] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:27.868388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:27.868388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:27.897710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 857/1715] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:27 2022] PUT /identity/v3/projects/706987cd4b6945ecab479f99f98fa11b/users/2056aeb18c834de29e1125066b355bb7/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:27.899067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:27.899474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:27.899717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:27.905912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd1e1-ba5f-459f-a52f-2d6eebb93a74 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:27.913325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:27.985218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] MFA Rules not processed for user `2056aeb18c834de29e1125066b355bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:27.986470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:28.106860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:28.106860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.106860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.106860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] PATH_INFO: `/v3/projects/38951a91beaf4888be968200185d1cc5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.107140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38951a91beaf4888be968200185d1cc5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:28.124446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:28.187033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 858/1716] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:28.200009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:28.221610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:28.330234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38951a91beaf4888be968200185d1cc5', 'request_id': 'req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:28.336952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48388d-95b2-4a5c-a636-2c02a2827053 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:28.439065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38951a91beaf4888be968200185d1cc5', 'request_id': 'req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:28.467384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38951a91beaf4888be968200185d1cc5', 'request_id': 'req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:28.491204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] The token cache is being invalidate because project 38951a91beaf4888be968200185d1cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:28.491634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:28.492498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69f08a0a-6a3e-4f28-b1a1-9f9a80e26b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:28.498440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 859/1717] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:27 2022] DELETE /identity/v3/projects/38951a91beaf4888be968200185d1cc5 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:28.500749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a46e5-2567-484e-8da4-da8da6ca0d90 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.501425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a46e5-2567-484e-8da4-da8da6ca0d90 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.501856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a46e5-2567-484e-8da4-da8da6ca0d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.531561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:28.532395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.532697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.532963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.534608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-357a46e5-2567-484e-8da4-da8da6ca0d90 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:28.535103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:28.536209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-357a46e5-2567-484e-8da4-da8da6ca0d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:28.626088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 860/1718] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:28.627459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.627763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.628044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.653854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:28.655528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:28.670550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 861/1719] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:28.671599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:28.681824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcc5e0-36cd-4c14-a379-2e83d9fb61af None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:28.687052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:28.687740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.688027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.688307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.693179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:28.693179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:28.693179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:28.695048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:28.700276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:28.704836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 862/1720] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:28.709345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:28.718316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:28.722335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213af12-0151-42ea-b9db-58a167eabcbc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:28.728189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 859/1721] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:28.751344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:28.752354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:28.753853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:28.754151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:28.755141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:28.758559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:28.936284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 863/1722] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:28 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:28.941560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:28.966719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db238ee-55f3-4309-9fac-ad1f256a67c0 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:29.103706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:29.140990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:29.141422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:29.149550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:29.149884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:29.152374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:29.160425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:29.161899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:29.162615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:29.196262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9295eb-fbb8-4cf2-acb1-a7404dfc1871 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:29.205341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:29.206672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:29.207127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:29.207551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] PATH_INFO: `/v3/users/358c172e3da947c1a2ef89a375c212f6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:29.209360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358c172e3da947c1a2ef89a375c212f6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:29.212111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:29.317319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 860/1723] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:28 2022] POST /identity/v3/users => generated 290 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:29.317319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:29.318290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:29.333968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ed73-123c-44b5-907f-605b71517460 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:29.342697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:29.343617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:29.343910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:29.344192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] PATH_INFO: `/v3/users/2056aeb18c834de29e1125066b355bb7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:29.346801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2056aeb18c834de29e1125066b355bb7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:29.354667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:29.597485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358c172e3da947c1a2ef89a375c212f6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.598227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358c172e3da947c1a2ef89a375c212f6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.601253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358c172e3da947c1a2ef89a375c212f6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.653025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358c172e3da947c1a2ef89a375c212f6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.694407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2056aeb18c834de29e1125066b355bb7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.695502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2056aeb18c834de29e1125066b355bb7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.781673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358c172e3da947c1a2ef89a375c212f6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.810901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 864/1724] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:29 2022] DELETE /identity/v3/users/358c172e3da947c1a2ef89a375c212f6 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:29.810901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:29.810901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:29.903733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b5ac-9162-4d61-b315-501a4c4ea168 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:29.909668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:29.911051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:29.911051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:29.915400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] PATH_INFO: `/v3/users/5c67a0c7d62b493db64798fe8a135da4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:29.915602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2056aeb18c834de29e1125066b355bb7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.915692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c67a0c7d62b493db64798fe8a135da4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:29.915692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:29.923288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2056aeb18c834de29e1125066b355bb7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.924248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40514b8d-0681-4b50-b417-bd86aca5545f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2056aeb18c834de29e1125066b355bb7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:29.966781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 861/1725] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:29 2022] DELETE /identity/v3/users/2056aeb18c834de29e1125066b355bb7 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:29.968389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:29.968771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:29.969058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:29.971509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 862/1726] 10.222.0.61 () {54 vars in 912 bytes} [Mon Jul 4 09:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:29.971706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:29.973930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.088321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2106fa-410a-4929-b216-7acd6175a3ff None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.119855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.121355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.121776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.123310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.123523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.126007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f626f56-9f4d-446b-bea3-6e6dbaf8a33b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.130122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:30.142604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 863/1727] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:30.144194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3259b3-3bca-47d3-9b46-38b296412e0b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.144563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3259b3-3bca-47d3-9b46-38b296412e0b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.145273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3259b3-3bca-47d3-9b46-38b296412e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.182858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c67a0c7d62b493db64798fe8a135da4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:30.183776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c67a0c7d62b493db64798fe8a135da4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:30.184503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c67a0c7d62b493db64798fe8a135da4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:30.189257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dd3259b3-3bca-47d3-9b46-38b296412e0b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.193585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd3259b3-3bca-47d3-9b46-38b296412e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.207091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c67a0c7d62b493db64798fe8a135da4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:30.214457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 864/1728] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:30.216124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8491e-2531-4700-b91d-190202d28036 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.216425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8491e-2531-4700-b91d-190202d28036 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.216711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8491e-2531-4700-b91d-190202d28036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.244541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-77b8491e-2531-4700-b91d-190202d28036 None None] MFA Rules not processed for user `fdc5beed67fc45f588145a525a12e1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.246529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-77b8491e-2531-4700-b91d-190202d28036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.330590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70d0d17b-a9e9-4252-847f-4af4a1d69534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c67a0c7d62b493db64798fe8a135da4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:30.359742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 865/1729] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:29 2022] DELETE /identity/v3/users/5c67a0c7d62b493db64798fe8a135da4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:30.362480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.362784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.363215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.377982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 865/1730] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:30.379995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2439-cea0-4414-b352-37b8eeaf97d2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.380303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2439-cea0-4414-b352-37b8eeaf97d2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.380589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2439-cea0-4414-b352-37b8eeaf97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.394991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.396557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.464175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f4fd2439-cea0-4414-b352-37b8eeaf97d2 None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.465906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4fd2439-cea0-4414-b352-37b8eeaf97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.528953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 866/1731] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:30.529745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.531123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.544929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3356-8e4c-4a04-b2c4-ac7cc522d08f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.551373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.552432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.552432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.552832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.553650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.556116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.571209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 867/1732] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:30.572247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.580301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.619577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 866/1733] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:30.625637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.625966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.626250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.670122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aab12-f0fc-433b-87e0-e74b9926c279 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.676427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.678419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.679080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.679187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.679876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.680444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.696847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.698447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 867/1734] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:30.698977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.699423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.701036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.719112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 868/1735] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:30.721875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.723330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f667b-da4b-4c47-92f9-775560c3725d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.732290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.732975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.733272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.733596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.746716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a2023-dd60-4af5-8bd2-ec32763e1444 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.756204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.757674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.760036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.762368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.762671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.767206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] PATH_INFO: `/v3/projects/de343da1842b4dee90e02ef68ea531c8/users/f6032960811d4e0bb8301abba1313e18/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.779795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 868/1736] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:30.781046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.803187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de343da1842b4dee90e02ef68ea531c8, user_id=f6032960811d4e0bb8301abba1313e18, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.808250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6c20a-d654-4d0b-b241-7073c2366532 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:30.813053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:30.814161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.814343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.821671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.826874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.856214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:30.857573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e829b-b611-4996-a2e6-23ab76ba8f44 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:30.881550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 869/1737] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:30.884156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954fa7e-1ad8-4b60-8fba-16855aa4c91d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:30.884451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954fa7e-1ad8-4b60-8fba-16855aa4c91d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:30.885470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954fa7e-1ad8-4b60-8fba-16855aa4c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:30.897593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 869/1738] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:30 2022] PUT /identity/v3/projects/de343da1842b4dee90e02ef68ea531c8/users/f6032960811d4e0bb8301abba1313e18/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:30.899286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:30.921801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f954fa7e-1ad8-4b60-8fba-16855aa4c91d None None] MFA Rules not processed for user `c0457bc532ce47aeabdec2643f53b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:30.923082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f954fa7e-1ad8-4b60-8fba-16855aa4c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:30.987893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:31.031210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96f7a-6925-4180-986b-e1841a5c287a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.043212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.044073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.045843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.045995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 870/1739] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:31.048161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.048494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.048895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.051390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.122884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] MFA Rules not processed for user `f6032960811d4e0bb8301abba1313e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:31.124294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:31.130756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.141338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.161584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 870/1740] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:31.239502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 871/1741] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:31.240713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:31.258221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3753e-6fa5-48fb-accb-0fe0dbc43d7d service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.268154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.269268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.271527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.272439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.273407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.277149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.456501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 871/1742] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:31 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:31.461742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:31.488281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01a849-d7b8-4629-bcfb-b57ad218cf86 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.617904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.618646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.618932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.619214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.620257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.628727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.758817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 872/1743] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:31 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:31.762871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:31.778650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d094-4cac-4a98-ab13-9215f1731dcd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.783986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:31.785605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:31.795927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.797605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.798101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.798885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.800271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.804014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0bf5-3ed2-41a5-87b1-4e1e60252495 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.815098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781930e8-07cb-4061-a368-bd01d8cd0449 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.822865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 872/1744] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:31.824813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e8e5-2d62-4e90-8b9b-26abc5735215 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.825752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e8e5-2d62-4e90-8b9b-26abc5735215 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.826405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e8e5-2d62-4e90-8b9b-26abc5735215 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.835516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 873/1745] 10.222.0.61 () {54 vars in 912 bytes} [Mon Jul 4 09:31:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:31.837021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.838464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.838777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.839099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53e8e5-2d62-4e90-8b9b-26abc5735215 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:31.839202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] PATH_INFO: `/v3/projects/36182b81e82e4e32b6c00967e8cf32fe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.841430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36182b81e82e4e32b6c00967e8cf32fe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.844567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.858051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53e8e5-2d62-4e90-8b9b-26abc5735215 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:31.866345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:31.868970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.869449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.870183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] PATH_INFO: `/v3/projects/1e45db0855b847ca8c4380b807dd316a/users/08e768df02f54269a9d200feda513014/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:31.894066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e45db0855b847ca8c4380b807dd316a, user_id=08e768df02f54269a9d200feda513014, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:31.897901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66beb4-ee36-4eaf-aa2f-91e61ff7ba57 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:31.903133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:31.978935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 874/1746] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:31 2022] PUT /identity/v3/projects/1e45db0855b847ca8c4380b807dd316a/users/08e768df02f54269a9d200feda513014/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:31.980144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fc93-0e06-4e22-a745-21a5e8d2b7ab None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:31.980446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fc93-0e06-4e22-a745-21a5e8d2b7ab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:31.980734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fc93-0e06-4e22-a745-21a5e8d2b7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.034661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-49e8fc93-0e06-4e22-a745-21a5e8d2b7ab None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:32.036380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-49e8fc93-0e06-4e22-a745-21a5e8d2b7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.059828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36182b81e82e4e32b6c00967e8cf32fe', 'request_id': 'req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.153307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36182b81e82e4e32b6c00967e8cf32fe', 'request_id': 'req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.169723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36182b81e82e4e32b6c00967e8cf32fe', 'request_id': 'req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.191641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] The token cache is being invalidate because project 36182b81e82e4e32b6c00967e8cf32fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:32.191955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.194801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f0dc0ac3-d45a-49c9-b9fd-1393967a367b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.196147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 875/1747] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:32.197761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.198326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.198834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.202110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 876/1748] 10.222.0.61 () {54 vars in 960 bytes} [Mon Jul 4 09:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:32.204799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.207746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.216249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:32.218608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 873/1749] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:31 2022] DELETE /identity/v3/projects/36182b81e82e4e32b6c00967e8cf32fe => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:32.219801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.220099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.221034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.280829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:32.281932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.348597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f2411-ee0e-4ca9-a532-df3c8c5498c1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:32.362378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:32.364554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.365881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.366519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.367681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:32.371791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:32.418843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 877/1750] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:32.419988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.424904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.435205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 874/1751] 10.222.0.61 () {58 vars in 1057 bytes} [Mon Jul 4 09:31:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:32.435987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.438557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.455097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abfd10-094c-44c4-9592-39405ac28266 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:32.460451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:32.461817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.462569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.462569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] PATH_INFO: `/v3/projects/706987cd4b6945ecab479f99f98fa11b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.463775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c86e6-09bd-4b1c-97cb-a65b07124222 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:32.463922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706987cd4b6945ecab479f99f98fa11b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:32.466781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:32.472270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:32.473391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.474412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.474887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] PATH_INFO: `/v3/users/299528117a1a41b49961fb736d71262c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.482646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299528117a1a41b49961fb736d71262c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:32.486596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:32.590714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706987cd4b6945ecab479f99f98fa11b', 'request_id': 'req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.683760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706987cd4b6945ecab479f99f98fa11b', 'request_id': 'req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.692712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706987cd4b6945ecab479f99f98fa11b', 'request_id': 'req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.717810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] The token cache is being invalidate because project 706987cd4b6945ecab479f99f98fa11b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:32.718796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.719089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.721593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 875/1752] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:32 2022] DELETE /identity/v3/projects/706987cd4b6945ecab479f99f98fa11b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:32.728390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.728390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.751367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299528117a1a41b49961fb736d71262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.752765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299528117a1a41b49961fb736d71262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.755649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299528117a1a41b49961fb736d71262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.790724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299528117a1a41b49961fb736d71262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.827272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e975e4-69c4-4b1a-a7c6-9c21c7a16263 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:32.831276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:32.831869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:32.832159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:32.832445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:32.834377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.845870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:32.847600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:32.857706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 876/1753] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:32.858675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.860234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.889914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299528117a1a41b49961fb736d71262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:32.909605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 878/1754] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:32 2022] DELETE /identity/v3/users/299528117a1a41b49961fb736d71262c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:32.915969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:32.918443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:32.953847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e963-39b1-4df5-aec8-6a7b6705b067 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:33.037194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121399-0c65-43ca-a0ec-2c1acd60e1b0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:33.044952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:33.045635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.045972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.046436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.048947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.056818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:33.058000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.058362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.058650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] PATH_INFO: `/v3/projects/1e45db0855b847ca8c4380b807dd316a/users/08e768df02f54269a9d200feda513014/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.061722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e45db0855b847ca8c4380b807dd316a, user_id=08e768df02f54269a9d200feda513014, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:33.065457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:33.065658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:33.068080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d788029-e587-403d-b2ed-b7b96963edec service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:33.079307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 877/1755] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:32 2022] PUT /identity/v3/projects/1e45db0855b847ca8c4380b807dd316a/users/08e768df02f54269a9d200feda513014/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:33.080298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:33.081695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 879/1756] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:33.089641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.092580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd551c-4d4c-471d-870e-62b895b9949f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.092874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd551c-4d4c-471d-870e-62b895b9949f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.093158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd551c-4d4c-471d-870e-62b895b9949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.127447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-79cd551c-4d4c-471d-870e-62b895b9949f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:33.130102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-79cd551c-4d4c-471d-870e-62b895b9949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.184705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766357b-6fac-4864-ac4d-940e925405f9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:33.189773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:33.190911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.191208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.191490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] PATH_INFO: `/v3/projects/d96dee2c4f814bcc9fc99e7e7ebbb924` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.192755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96dee2c4f814bcc9fc99e7e7ebbb924)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:33.194876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:33.243437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 880/1757] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:33.245415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439557-04dd-4647-93fe-80ecba1764cf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.245779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439557-04dd-4647-93fe-80ecba1764cf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.246136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439557-04dd-4647-93fe-80ecba1764cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.332010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-09439557-04dd-4647-93fe-80ecba1764cf None None] MFA Rules not processed for user `08e768df02f54269a9d200feda513014`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:33.333448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-09439557-04dd-4647-93fe-80ecba1764cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.442518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 881/1758] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:33.447801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.448370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.448655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.456399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96dee2c4f814bcc9fc99e7e7ebbb924', 'request_id': 'req-763d6049-5c75-46b6-b6c3-f130e2dfe911'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:33.472587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] MFA Rules not processed for user `252b0cfb5934429ba31adc44ee4a556e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:33.474735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.543795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96dee2c4f814bcc9fc99e7e7ebbb924', 'request_id': 'req-763d6049-5c75-46b6-b6c3-f130e2dfe911'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:33.553649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96dee2c4f814bcc9fc99e7e7ebbb924', 'request_id': 'req-763d6049-5c75-46b6-b6c3-f130e2dfe911'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:33.571068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] The token cache is being invalidate because project d96dee2c4f814bcc9fc99e7e7ebbb924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:33.571624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:33.572794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-763d6049-5c75-46b6-b6c3-f130e2dfe911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:33.575082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 878/1759] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:33 2022] DELETE /identity/v3/projects/d96dee2c4f814bcc9fc99e7e7ebbb924 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:33.603189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.603716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.604409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.651423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:33.653095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.685974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 882/1760] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:33.686898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:33.696194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.752552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:33.761256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 879/1761] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:33.761256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:33.761631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.792458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f525e-09ae-4866-853b-ce9364cd34ef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:33.799790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:33.806908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.807209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.807487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] PATH_INFO: `/v3/users/a8ba250337554efb9a09283dceb7c8e6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.819252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ba250337554efb9a09283dceb7c8e6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:33.822963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:33.877085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b621c-d526-4788-b0fd-2bdd4691029f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:33.882233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:33.884033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:33.886322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:33.886735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:33.891838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:33.941894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:34.071540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.073118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.124451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 883/1762] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:34.126909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:34.136356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ba250337554efb9a09283dceb7c8e6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.137097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ba250337554efb9a09283dceb7c8e6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.148336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90b7f-25c4-42c4-b8fc-b42771545d84 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:34.156305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:34.157471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.157923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.163760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.164896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:34.165541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.168131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.192976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ba250337554efb9a09283dceb7c8e6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.205203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 884/1763] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:34.207043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:34.212671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ba250337554efb9a09283dceb7c8e6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.213434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ba250337554efb9a09283dceb7c8e6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.213637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:34.230370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ef08-c7b6-4fb4-b49b-48b393793684 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:34.237397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:34.238464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.238857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.239229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] PATH_INFO: `/v3/projects/cbf16d879b5045eabaa2eec05e0801b2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.240838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf16d879b5045eabaa2eec05e0801b2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.254841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.289613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 880/1764] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:33 2022] DELETE /identity/v3/users/a8ba250337554efb9a09283dceb7c8e6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:34.289613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:34.301695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:34.313441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:34.435477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db48a3-8c1d-474f-856c-5b19d951df2a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:34.455411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf16d879b5045eabaa2eec05e0801b2', 'request_id': 'req-ba9e77c6-f08a-4a28-911e-08c79140fc53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.549194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:34.549885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.550374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.550661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.551368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.553313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.564265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf16d879b5045eabaa2eec05e0801b2', 'request_id': 'req-ba9e77c6-f08a-4a28-911e-08c79140fc53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.574561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf16d879b5045eabaa2eec05e0801b2', 'request_id': 'req-ba9e77c6-f08a-4a28-911e-08c79140fc53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.593072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] The token cache is being invalidate because project cbf16d879b5045eabaa2eec05e0801b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:34.595264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.595759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ba9e77c6-f08a-4a28-911e-08c79140fc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:34.613293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 885/1765] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:34 2022] DELETE /identity/v3/projects/cbf16d879b5045eabaa2eec05e0801b2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:34.616444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48d00-20c8-4c5a-9c1d-6a6cae62013f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.616893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48d00-20c8-4c5a-9c1d-6a6cae62013f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.617186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48d00-20c8-4c5a-9c1d-6a6cae62013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.658645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c9a48d00-20c8-4c5a-9c1d-6a6cae62013f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:34.662236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9a48d00-20c8-4c5a-9c1d-6a6cae62013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:34.682568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 886/1766] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:34.688656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.688941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.689242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.717263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:34.718649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:34.735531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 887/1767] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:34.736495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:34.742280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 881/1768] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:34 2022] POST /identity/v3/projects => generated 381 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:34.746592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:34.748709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:34.783586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef326ab-7f31-4b0e-ae09-496ea794c57a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:34.830130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:34.921592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2f634-334f-4921-9b76-e26ef624bcc5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:34.943217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:34.944112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.944491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.945601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.946877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.949499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.950653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:34.951959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:34.952354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:34.952711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:34.954007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:34.954365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:34.959646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:34.991170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 888/1769] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:34.995701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.016270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e7058-f157-4f15-8d9c-5bf3ba90c48b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.066087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.066823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.067115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.067407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.068134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.089392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.159995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 882/1770] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:34 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:35.161755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.200040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0a1a-13ab-42dc-bbbd-31fc94aa0ea2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.219870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.221213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.222087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.223029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.233301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.238016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.264529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 889/1771] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:35.269935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.275339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 883/1772] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:35.279440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.308143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d2585-2e7f-48fc-aa45-e54975118fad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.418896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989297b7-24d6-4921-9faf-80ab4ea522df admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.439655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.441012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.441787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.442081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.442576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.442799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.442910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.443206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.446864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.447211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.447211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.447575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.461565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 884/1773] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:35.462494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.466137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:35.486819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61589-6fad-4045-be1a-f629704e03cb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.491638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.493026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.493312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.493593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] PATH_INFO: `/v3/projects/f955220eab934b989b92602ce64e6280` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.495134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f955220eab934b989b92602ce64e6280)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.497054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.575407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 890/1774] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:35 2022] POST /identity/v3/users => generated 287 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:35.576514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.589210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bf4d-740f-473f-9901-9cb322eccc6a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.595064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.595971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.597188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.597188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] PATH_INFO: `/v3/projects/55166a6f38f34525bb9da1ec9eea3292/users/1a573154b81e471d9957687f05b77735/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.612431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55166a6f38f34525bb9da1ec9eea3292, user_id=1a573154b81e471d9957687f05b77735, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.615183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.728169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 891/1775] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:35 2022] PUT /identity/v3/projects/55166a6f38f34525bb9da1ec9eea3292/users/1a573154b81e471d9957687f05b77735/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:35.729368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.733731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:35.748710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f955220eab934b989b92602ce64e6280', 'request_id': 'req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:35.819445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1c4de-9851-4332-bc34-8f14e20c937f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:35.869061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f955220eab934b989b92602ce64e6280', 'request_id': 'req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:35.878918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f955220eab934b989b92602ce64e6280', 'request_id': 'req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:35.893343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] The token cache is being invalidate because project f955220eab934b989b92602ce64e6280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:35.895578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:35.896360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e768df02f54269a9d200feda513014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e45db0855b847ca8c4380b807dd316a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:35.900301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:35.900416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.900416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.900416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.900596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 885/1776] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:35 2022] DELETE /identity/v3/projects/f955220eab934b989b92602ce64e6280 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:35.900693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:35.900693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:35.900819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:35.900819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:35.900937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de1fb-ec75-4221-887a-c44797d65c87 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:35.920024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 892/1777] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:35.920024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa05e-3c73-48fa-8923-2a2b4cdf6905 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:35.920024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa05e-3c73-48fa-8923-2a2b4cdf6905 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:35.920024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa05e-3c73-48fa-8923-2a2b4cdf6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:35.977722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-492fa05e-3c73-48fa-8923-2a2b4cdf6905 None None] MFA Rules not processed for user `1a573154b81e471d9957687f05b77735`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:35.979923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-492fa05e-3c73-48fa-8923-2a2b4cdf6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:36.097296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 893/1778] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:36.103734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.106471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.107473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.112135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbcd8c-f7e1-493f-bbfb-23187cd67bfe admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.131241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.131836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:36.131946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.132238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.132613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.133519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.134320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:36.135161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.153168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 894/1779] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:36.154456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.156041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:36.165384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 886/1780] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:36.166419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.171853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:36.187651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e2cdc-6d10-45c6-8ccd-e3d9555eb7bd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.199631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e768df02f54269a9d200feda513014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e45db0855b847ca8c4380b807dd316a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.202299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.202604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.204892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea630491-d536-42e2-9768-70001dedfd64 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.205025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.206039 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.210684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8859fd-cebd-41a7-ab50-16a22beb1f5e tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.223041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.223876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.224270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.224668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.225904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.232049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.341219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 895/1781] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/projects => generated 354 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:36.349432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.358484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.358863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.412792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 887/1782] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:36.414305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.425162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:36.448346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:36.451381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:36.532794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1c36-0091-4a7d-8feb-5b8354347536 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.556061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.556760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.557131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.557337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.558182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.560245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.562327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 896/1783] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:36.563465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.584226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 888/1784] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:36.584226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.610795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d29df-d73d-4571-a729-4b542fd75db8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.616708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.617918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.618231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.618525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.619456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.623320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.672856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3c1dd-2a14-4855-83d6-514957867072 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.678497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e768df02f54269a9d200feda513014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e45db0855b847ca8c4380b807dd316a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.679618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.680098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.680562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.682132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:36.683402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.685896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.702117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 897/1785] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:36.709670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.727099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52410d6b-437d-4a08-816e-3a0d96ccaf5c tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.735209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.736281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.736800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.737282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.739346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:36.740138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.742337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.771463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 889/1786] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:36.772475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.774683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 898/1787] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:36.777008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.795624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401d17-cada-42d2-9a3f-ef07e85b2cdc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.804947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5f97-3de2-4b1c-903f-81d25c9aaee3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.812993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.815124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.815567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.815869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.816658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.819094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.826349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.827285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.827876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.828262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] PATH_INFO: `/v3/projects/68dd544746a4420087e1fec451e2e63e/users/88e0c06ab3c4434c93890c5cda9cde5e/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.850480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 899/1788] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:36.850480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:36.858991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dd544746a4420087e1fec451e2e63e, user_id=88e0c06ab3c4434c93890c5cda9cde5e, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.861771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:36.868718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834bb-b44b-4726-a1fc-9edf6279da02 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:36.874609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:36.877507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:36.877507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:36.877507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:36.877507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:36.879160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:37.030503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 890/1789] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:36 2022] PUT /identity/v3/projects/68dd544746a4420087e1fec451e2e63e/users/88e0c06ab3c4434c93890c5cda9cde5e/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:37.031609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:37.069667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 900/1790] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:36 2022] POST /identity/v3/projects => generated 409 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:37.077997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:37.202346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e25c-83f3-4ccd-9378-6b1921fbe30d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:37.206743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186081-4e5e-4996-bf10-d7588ceb98ce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:37.219797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:37.220493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:37.220932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:37.221228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] PATH_INFO: `/v3/projects/6973252a07e74e9794b43d0e259718b4/users/913a70897a7449aba4a64af71ac5d001/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:37.263921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6973252a07e74e9794b43d0e259718b4, user_id=913a70897a7449aba4a64af71ac5d001, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:37.266814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4747cd-04af-41d5-94b8-ae820420d9d0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:37.295953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:37.393480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 901/1791] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:37 2022] PUT /identity/v3/projects/6973252a07e74e9794b43d0e259718b4/users/913a70897a7449aba4a64af71ac5d001/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:37.395215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:37.395710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:37.396213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:37.445873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e768df02f54269a9d200feda513014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e45db0855b847ca8c4380b807dd316a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:37.446958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:37.447469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:37.448061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] PATH_INFO: `/v3/projects/eeee77742e514a419e5b2d7ae2de3dd6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:37.449456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eeee77742e514a419e5b2d7ae2de3dd6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:37.451633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:37.478078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] MFA Rules not processed for user `88e0c06ab3c4434c93890c5cda9cde5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:37.479572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:37.638648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeee77742e514a419e5b2d7ae2de3dd6', 'request_id': 'req-e5ba9441-dfe8-41c8-aa21-3217539373b9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:37.655150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 902/1792] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:37.656209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:37.748595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeee77742e514a419e5b2d7ae2de3dd6', 'request_id': 'req-e5ba9441-dfe8-41c8-aa21-3217539373b9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:37.765159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeee77742e514a419e5b2d7ae2de3dd6', 'request_id': 'req-e5ba9441-dfe8-41c8-aa21-3217539373b9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:37.809263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] The token cache is being invalidate because project eeee77742e514a419e5b2d7ae2de3dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:37.809263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:37.810315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:37.820656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 891/1793] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:37 2022] DELETE /identity/v3/projects/eeee77742e514a419e5b2d7ae2de3dd6 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:37.820656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:37.826288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:37.863488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf347-7480-4fd7-a444-7160c9407a0e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:37.931587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:37.999443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9441-dfe8-41c8-aa21-3217539373b9 tempest-VolumeQuotaClassesTest-1485873147 tempest-VolumeQuotaClassesTest-1485873147-project-admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.004896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.005763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.006049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.006441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.007230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.007741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.008635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.008938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.009243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.009726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.010651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.013283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.020982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 892/1794] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:38.021674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.029273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.046179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01081b16-6d23-4da6-8709-cb37549f21df admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.051386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.052150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.052544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.052902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.053790 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.056069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.165058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 903/1795] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:37 2022] POST /identity/v3/users => generated 305 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:38.167772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.183120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bbb8a-363a-473e-8948-72f9034366ef admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.208668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.209610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.209903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.210203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] PATH_INFO: `/v3/projects/6973252a07e74e9794b43d0e259718b4/users/913a70897a7449aba4a64af71ac5d001/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.219613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6973252a07e74e9794b43d0e259718b4, user_id=913a70897a7449aba4a64af71ac5d001, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.226568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.236688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 893/1796] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:38 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:38.237975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.240567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.283293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 904/1797] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:38 2022] PUT /identity/v3/projects/6973252a07e74e9794b43d0e259718b4/users/913a70897a7449aba4a64af71ac5d001/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:38.284213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.420656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7b15-4c07-4a3c-a009-5a9b985a47e7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.490815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f4db-4636-4d33-acc2-fde6381b52f6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.502743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.504696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.504982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.505265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.508180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.510968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ff8a-5ca5-4149-aa76-7d9ad064eb06 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.548048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.550627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.551033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.551414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.552437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.554899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e753-6d48-4fd2-8081-78ed3781d4f8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.572749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 894/1798] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:38.572749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.572749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.572749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.599341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 905/1799] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:38 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:38.600980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.601293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.601579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.636914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:38.643382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] MFA Rules not processed for user `913a70897a7449aba4a64af71ac5d001`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:38.645049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.652979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.776128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:38.796080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 895/1800] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:38.801622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.818154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77b43-d85f-430f-9a0c-d16f2261eaee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.823987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.825103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.825366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.825964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.826749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.828508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.850637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 896/1801] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:38.850637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.856306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 906/1802] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:38.857391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.859927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.875211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb387-c70e-4748-b645-c4c527ba7f24 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.886606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.887336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.887629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.887914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:38.888687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:38.890385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:38.905751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 897/1803] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:38.907024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:38.917265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:38.979782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a62835-60bd-4a40-8a56-75cb2aa6dcc2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:38.985005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:38.990125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:38.990125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:38.990125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:39.001125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:39.003095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:39.004629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b8c9a-937c-4aee-a883-52b321a684c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:39.018930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 907/1804] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:39.018930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:39.049087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:39.052460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:39.052960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:39.055158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] PATH_INFO: `/v3/users/f6032960811d4e0bb8301abba1313e18` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:39.062219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6032960811d4e0bb8301abba1313e18)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:39.065808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:39.078908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063830bd-435a-4083-9d6b-56455e9fbf30 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:39.097380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:39.099529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:39.099863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:39.100191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] PATH_INFO: `/v3/projects/2280f82cc9444b5fb2b141e922c5ccf1/users/9a91425138524db7873485d476d40f23/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:39.133870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2280f82cc9444b5fb2b141e922c5ccf1, user_id=9a91425138524db7873485d476d40f23, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:39.137743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:39.454742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 908/1805] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:39 2022] PUT /identity/v3/projects/2280f82cc9444b5fb2b141e922c5ccf1/users/9a91425138524db7873485d476d40f23/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:39.454742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:39.531166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06045c7a-e06b-472b-857a-b093ea04ece8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:39.537810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:39.539305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:39.539593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:39.541115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] PATH_INFO: `/v3/projects/efa0fdc645f2495e87107a02e1e411a2/users/404864e8c91a4bcdb3ac02d2e0f74f30/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:39.573771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6032960811d4e0bb8301abba1313e18'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:39.575861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6032960811d4e0bb8301abba1313e18'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:39.587038 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa0fdc645f2495e87107a02e1e411a2, user_id=404864e8c91a4bcdb3ac02d2e0f74f30, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:39.589855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:39.645254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6032960811d4e0bb8301abba1313e18'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:39.658878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6032960811d4e0bb8301abba1313e18'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:39.659583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95876326-105f-412f-b0e7-1b9b4eec5515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6032960811d4e0bb8301abba1313e18'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:39.684932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 909/1806] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:39 2022] PUT /identity/v3/projects/efa0fdc645f2495e87107a02e1e411a2/users/404864e8c91a4bcdb3ac02d2e0f74f30/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:39.696345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:39.696345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:39.706086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 898/1807] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:38 2022] DELETE /identity/v3/users/f6032960811d4e0bb8301abba1313e18 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:39.708708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:39.709263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:39.709851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:39.787635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] MFA Rules not processed for user `9a91425138524db7873485d476d40f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:39.789007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:39.864619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5923-e308-4a36-99ea-8ad18093228f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:39.965415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 899/1808] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:39.966689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:39.969027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.006661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.007483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.007779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.008218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.010332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.059275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb8f3-dfbb-4817-9788-b7849f6b2853 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.064001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.065662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.066101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.066654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.069179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.152006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.153688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:40.167198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 900/1809] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:40.168139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:40.170446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.195204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.197364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dcee4-4bc7-4ddc-ba00-7a9b4a369f78 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:40.246946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 910/1810] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:31:40.249526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede34c1-6860-4440-8ed2-131c44d3b24c service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.254701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.255605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.255817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.256102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.256992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.260785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:40.277565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 901/1811] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:40.278429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:40.291442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.305716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba3eb-ec89-4f81-9128-4cff39c9a4c1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.306023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba3eb-ec89-4f81-9128-4cff39c9a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.308642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba3eb-ec89-4f81-9128-4cff39c9a4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.309985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa330-b9a4-4ab8-b5aa-35c68e0e6261 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.314416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:40.328445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.333678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.334941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.338470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.341592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.352553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:40.388458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:40.396455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-46eba3eb-ec89-4f81-9128-4cff39c9a4c1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:40.400485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-46eba3eb-ec89-4f81-9128-4cff39c9a4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.446737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 911/1812] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:40.458322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.459614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.461100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.491130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 902/1813] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:40 2022] POST /identity/v3/projects => generated 407 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:40.493387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:40.545084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:40.560125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.733792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee69c9-8215-4318-b41a-f29e1f383325 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.749435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.750393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.750682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.750963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] PATH_INFO: `/v3/projects/efa0fdc645f2495e87107a02e1e411a2/users/404864e8c91a4bcdb3ac02d2e0f74f30/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.759843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa0fdc645f2495e87107a02e1e411a2, user_id=404864e8c91a4bcdb3ac02d2e0f74f30, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.763342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:40.777277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 912/1814] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 4 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:40.778175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:40.814117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 903/1815] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:40 2022] PUT /identity/v3/projects/efa0fdc645f2495e87107a02e1e411a2/users/404864e8c91a4bcdb3ac02d2e0f74f30/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:40.815152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:40.824837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:40.827491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f00f-cfc1-4a24-9be8-c9e14741a1a5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.907318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc978d1-928e-4d3a-ab2b-7d2afee606d3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:40.914641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.915379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.915664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.915937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.962040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:40.963969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:40.964360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:40.964647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:40.965428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:40.967684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40321b8-6bb6-49b2-89f2-b829be50d2a0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:41.099693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:41.102021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:41.108425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 913/1816] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:40 2022] POST /identity/v3/users => generated 310 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:41.109976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:41.112451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:41.118868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:41.158796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 904/1817] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:41.163041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:41.168345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:41.225517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] MFA Rules not processed for user `404864e8c91a4bcdb3ac02d2e0f74f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:41.226850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:41.237163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55cf7-b3a2-452e-8b53-48ab9bdfc352 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:41.253592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:41.260205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:41.262016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:41.263045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:41.296016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:41.300786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:41.328701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 905/1818] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:41.329982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:41.357164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a288-44a1-4672-98f8-2d29aa0ea1c5 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:41.373864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:41.375002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:41.375701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:41.376489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:41.378108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:41.380408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:41.407538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 906/1819] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:41.411527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:41.429546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee37fb-abe8-4d0e-8092-0a47e28ef5b1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:41.445161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:41.446326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:41.451354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:41.455454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] PATH_INFO: `/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16/users/cb83ab5a7611474584f640c0a9398386/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:41.509482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a459b96aa274afb8c21b9fe9d23cc16, user_id=cb83ab5a7611474584f640c0a9398386, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:41.522753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 914/1820] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:41.534555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:41.543957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:41.634060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 907/1821] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:41 2022] PUT /identity/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16/users/cb83ab5a7611474584f640c0a9398386/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:41.638248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:41.689930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:42.156354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60fbe9-bb0c-4039-8b45-cba48a4d9a4e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:42.156354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:42.156354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:42.156354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:42.219090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:42.219090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:42.219090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:42.221505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814df4c3-fb36-467b-a30f-42cabd789866 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:42.222663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 908/1822] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:42.223414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:42.223414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:42.223414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:42.223414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:42.238071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:42.299135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:42.299135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02efb24-558f-43cd-989f-bf96a5ba0ab5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:42.300015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:42.300015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57438-9aba-4165-887e-7185aa67c120 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:42.300474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:42.300474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:42.300474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:42.300474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] PATH_INFO: `/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16/users/cb83ab5a7611474584f640c0a9398386/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:42.301056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a459b96aa274afb8c21b9fe9d23cc16, user_id=cb83ab5a7611474584f640c0a9398386, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:42.301638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 915/1823] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:42.301814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:42.301814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 909/1824] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:42 2022] PUT /identity/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16/users/cb83ab5a7611474584f640c0a9398386/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:42.302050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:42.302050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:42.302050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:42.386320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] MFA Rules not processed for user `cb83ab5a7611474584f640c0a9398386`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:42.386320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:42.637450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 916/1825] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:42.953591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:43.343716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:43.483207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054aa40-cf05-4d43-990e-ada9de1cd06a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:43.492656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:43.493780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:43.494080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:43.494933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:43.509517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:43.524359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:43.561141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 910/1826] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:43.816890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:44.140643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:44.142898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:44.175730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:44.191934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd2067-9618-4850-8156-ced28106c65c service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:44.203172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:44.205090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:44.205655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:44.206379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:44.308782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0afbad-ef78-4f19-86e4-fdb45a6d9e5d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:44.315195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:44.319214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:44.319669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:44.324505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] PATH_INFO: `/v3/projects/de343da1842b4dee90e02ef68ea531c8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:44.324505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de343da1842b4dee90e02ef68ea531c8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:44.324795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:44.353284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:44.361291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:44.391394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 911/1827] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:44.549901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de343da1842b4dee90e02ef68ea531c8', 'request_id': 'req-2a33ad08-565c-4ef6-ae32-5e50d2be1051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:44.674384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de343da1842b4dee90e02ef68ea531c8', 'request_id': 'req-2a33ad08-565c-4ef6-ae32-5e50d2be1051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:44.688644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de343da1842b4dee90e02ef68ea531c8', 'request_id': 'req-2a33ad08-565c-4ef6-ae32-5e50d2be1051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:44.739800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] The token cache is being invalidate because project de343da1842b4dee90e02ef68ea531c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:44.739800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:44.739800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a33ad08-565c-4ef6-ae32-5e50d2be1051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:44.751509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 917/1828] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:44 2022] DELETE /identity/v3/projects/de343da1842b4dee90e02ef68ea531c8 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:44.754356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:44.786914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9694d-db71-405f-b4f4-4e212450efd3 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:44.817237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:44.958532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:44.964535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:44.964535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:44.964535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] PATH_INFO: `/v3/users/08e768df02f54269a9d200feda513014` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:44.969698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e768df02f54269a9d200feda513014)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:44.974116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:45.031690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff1cb-1e91-4702-93f3-fbd4a7bfb9e5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:45.032247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff1cb-1e91-4702-93f3-fbd4a7bfb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:45.032247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff1cb-1e91-4702-93f3-fbd4a7bfb9e5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:45.034678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 918/1829] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:31:45.067893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3ba8b-9b4e-43d5-8ec0-20256fa8956d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:45.068419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3ba8b-9b4e-43d5-8ec0-20256fa8956d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:45.068873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3ba8b-9b4e-43d5-8ec0-20256fa8956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:45.144486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-29d3ba8b-9b4e-43d5-8ec0-20256fa8956d None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:45.155409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29d3ba8b-9b4e-43d5-8ec0-20256fa8956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:45.271014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e768df02f54269a9d200feda513014'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:45.273186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e768df02f54269a9d200feda513014'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:45.450318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 919/1830] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:45.452025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af5fc-07ed-486d-848e-821ec979ade6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:45.452477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af5fc-07ed-486d-848e-821ec979ade6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:45.453052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af5fc-07ed-486d-848e-821ec979ade6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:45.454757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 920/1831] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:31:45.484185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e768df02f54269a9d200feda513014'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:45.502475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e768df02f54269a9d200feda513014'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:45.503957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e768df02f54269a9d200feda513014'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:45.530254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 912/1832] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:44 2022] DELETE /identity/v3/users/08e768df02f54269a9d200feda513014 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:45.678289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:45.678652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:45.678886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:45.714321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:45.715555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:45.732107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:45.898859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 921/1833] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:45.975436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:45.977989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:46.038083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45f377-25ea-43a1-ab4b-12d8fe041f3d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:46.057184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:46.057875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:46.058163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:46.058468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:46.072338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:46.073839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:46.107908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 913/1834] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:46.489791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:46.492483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:46.520287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087f8f-170d-4d47-b05d-b11a9e2e9bc2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:46.556875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:46.558428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:46.558884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:46.559166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:46.578824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:46.580686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:46.594403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 922/1835] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:47.286659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:47.289503 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:47.358893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dbdb9-d505-49bb-801b-df31d35084fe service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:47.364242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:47.364980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:47.365381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:47.365863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:47.371806 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:47.530426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:47.535728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b309d9-c4ae-4d4e-a1b9-a1eca3603de2 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:47.576868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 914/1836] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:47.992508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:47.993961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:48.192953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf9ed6-deaf-4a1d-b944-e709c993b9d4 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:48.227344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:48.228409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:48.233057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:48.233358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] PATH_INFO: `/v3/projects/1e45db0855b847ca8c4380b807dd316a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:48.237470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e45db0855b847ca8c4380b807dd316a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:48.239664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:48.407185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e45db0855b847ca8c4380b807dd316a', 'request_id': 'req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:48.423240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:48.500518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e45db0855b847ca8c4380b807dd316a', 'request_id': 'req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:48.508687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e45db0855b847ca8c4380b807dd316a', 'request_id': 'req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:48.530566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] The token cache is being invalidate because project 1e45db0855b847ca8c4380b807dd316a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:48.531987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:48.533237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cdbf3176-2873-4e46-91b2-d0a1c45f5a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:48.536440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 923/1837] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:47 2022] DELETE /identity/v3/projects/1e45db0855b847ca8c4380b807dd316a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:48.541595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:48.542232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:48.542232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:48.590809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:48.594458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:48.598970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:48.832484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:48.832779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:48.833067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:48.844328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 915/1838] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:48.859638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:48.861623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:48.875598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 924/1839] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:48.876866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:48.890740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdb236-7187-4de9-9d7f-f91fc3e11e35 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:48.904533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:48.913777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:48.944940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 916/1840] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:48.945229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:48.956450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63993d-ce91-4c15-aba3-1a8768cbfdc8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:48.963992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:48.965393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:48.966069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:48.967249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:48.969052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:48.973165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:49.163547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 925/1841] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:48 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:49.173637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:49.223235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68dfa-8dfa-4872-9183-90d60c241894 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:49.413230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:49.414497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:49.419531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:49.419531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:49.419531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:49.419531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:49.552260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 917/1842] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:49 2022] POST /identity/v3/users => generated 295 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:49.556805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:49.569801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190dcb-4f03-4115-aa82-87fe2c94a5d5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:49.576090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:49.577251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:49.578004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:49.578759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:49.579777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:49.581757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:49.622970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 926/1843] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:49.626958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:49.653239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a0abd-7bf4-4025-b2df-459613959b49 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:49.659969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:49.661096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:49.661666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:49.662146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:49.663775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:49.665898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c228bb-c8fd-4dd8-bde7-1d7235411391 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:49.679058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 918/1844] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:49.684089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:49.701785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612123-2372-47ec-aa0a-d6056d45bbb1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:49.715738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:49.717094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:49.717636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:49.718137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] PATH_INFO: `/v3/projects/62d9727da54341cf8ffc1ee2b2f8d960/users/9632ab1134ba49fb9ac13994c82e4e23/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:49.751166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d9727da54341cf8ffc1ee2b2f8d960, user_id=9632ab1134ba49fb9ac13994c82e4e23, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:49.759051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:49.858858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 927/1845] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:49 2022] PUT /identity/v3/projects/62d9727da54341cf8ffc1ee2b2f8d960/users/9632ab1134ba49fb9ac13994c82e4e23/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:49.872443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:49.873029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:49.873590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:49.946536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] MFA Rules not processed for user `9632ab1134ba49fb9ac13994c82e4e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:49.949173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:50.072540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 919/1846] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:50.075741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:50.299092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1d53d-c9ae-410c-9116-674108849ca1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:50.299092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:50.299092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:50.299092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:50.301819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:50.301819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:50.301819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.038634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 928/1847] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:50 2022] POST /identity/v3/projects => generated 387 bytes in 963 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:51.043863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.066129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ca2d-cb66-4e97-a1a1-92041815f010 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.185971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.186737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.187003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.187295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.187996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.189957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.280090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 920/1848] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:51 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:51.288851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.296596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d7e3-cd64-4ead-95cc-2d1616d77b93 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.302243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.308274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.308274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.308274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.308274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.308274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.320320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 929/1849] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:51.323921 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.337605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efd81-4489-4cbf-998b-3b671062356f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.346949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.348094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.350182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.351152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] PATH_INFO: `/v3/projects/45617a5007e2454eb7ffd14d69c31855/users/4157e77ce8e34b9b93628775b3c5eb63/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.393596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45617a5007e2454eb7ffd14d69c31855, user_id=4157e77ce8e34b9b93628775b3c5eb63, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.396605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.495013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 921/1850] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:51 2022] PUT /identity/v3/projects/45617a5007e2454eb7ffd14d69c31855/users/4157e77ce8e34b9b93628775b3c5eb63/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:51.499375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.514917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1318-7cf0-4343-b9af-15627606780c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.628306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.629219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.629653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.631226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.642640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.642640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dc3e4-1abe-4cbf-9281-3758e7ddf378 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.655410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 930/1851] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:51.660427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.662375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:51.677125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672512-e9ce-4256-9e81-0576211466f6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.683103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.684534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.684863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.685387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] PATH_INFO: `/v3/projects/45617a5007e2454eb7ffd14d69c31855/users/4157e77ce8e34b9b93628775b3c5eb63/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.689597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=45617a5007e2454eb7ffd14d69c31855, user_id=4157e77ce8e34b9b93628775b3c5eb63, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.693199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.708803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 922/1852] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:51 2022] PUT /identity/v3/projects/45617a5007e2454eb7ffd14d69c31855/users/4157e77ce8e34b9b93628775b3c5eb63/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:51.720854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.721146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.723701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.754694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] MFA Rules not processed for user `4157e77ce8e34b9b93628775b3c5eb63`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:51.756053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:51.852277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 931/1853] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:51.863892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:51.870334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:51.947374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123588d-0006-403f-a256-080d704ab0fd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:51.956587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:51.958442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:51.958914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:51.961810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:51.974895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:51.976690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503034a2-0e9f-44aa-a5ac-71d1f2653015 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:51.988612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 923/1854] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:52.172252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:52.277897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b03f44-3058-41b6-89d5-80a4b90f5ac2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:52.283126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:52.284181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:52.284775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:52.285255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] PATH_INFO: `/v3/users/9632ab1134ba49fb9ac13994c82e4e23` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:52.286918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9632ab1134ba49fb9ac13994c82e4e23)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:52.289997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:52.587561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9632ab1134ba49fb9ac13994c82e4e23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:52.589098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9632ab1134ba49fb9ac13994c82e4e23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:52.590377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9632ab1134ba49fb9ac13994c82e4e23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:52.633522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9632ab1134ba49fb9ac13994c82e4e23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:52.706455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9632ab1134ba49fb9ac13994c82e4e23'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:52.724123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 932/1855] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:52 2022] DELETE /identity/v3/users/9632ab1134ba49fb9ac13994c82e4e23 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:52.728938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:52.729463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:52.729573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:52.765618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:52.767506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:52.776033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:52.777777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:52.878014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 924/1856] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:52.895277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:52.896762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:52.901618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba02c8-3c07-4e8b-8778-0e0517b79a8f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:52.907358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:52.909761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:52.910403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:52.910642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] PATH_INFO: `/v3/users/1a573154b81e471d9957687f05b77735` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:52.911932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a573154b81e471d9957687f05b77735)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:52.914538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:52.931420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:53.013739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851ceab-3428-4d0e-bc90-7a6d5d259262 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:53.018656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:53.019609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.019904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.020202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.037313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:53.039708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:53.070324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 925/1857] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:53.135336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a573154b81e471d9957687f05b77735'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.136078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a573154b81e471d9957687f05b77735'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.136689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a573154b81e471d9957687f05b77735'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.153558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a573154b81e471d9957687f05b77735'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.154482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:53.157101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.174561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec146-544f-4d47-b5f9-a680e1f8117c service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:53.179867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:53.180895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.181084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.181362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] PATH_INFO: `/v3/users/9a91425138524db7873485d476d40f23` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.182667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a91425138524db7873485d476d40f23)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:53.184827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:53.290404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2fdf19d7-265c-4381-aa59-d185a247cfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a573154b81e471d9957687f05b77735'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.304231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 933/1858] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:52 2022] DELETE /identity/v3/users/1a573154b81e471d9957687f05b77735 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:53.308819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.309110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.309386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.326937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:53.328300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.407770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 934/1859] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:53.425373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:53.427179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.502507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753b69-66f4-4beb-8867-de04a62f14fa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:53.509414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:53.514683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.514974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.515299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.528607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:53.529803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a91425138524db7873485d476d40f23'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.530490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac682-65c8-479d-bac3-29ef9c4674f3 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:53.530671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a91425138524db7873485d476d40f23'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.541454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 935/1860] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:53.603134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a91425138524db7873485d476d40f23'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.611164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a91425138524db7873485d476d40f23'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.611856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a91425138524db7873485d476d40f23'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:53.630109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 926/1861] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:53 2022] DELETE /identity/v3/users/9a91425138524db7873485d476d40f23 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:53.635323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.635927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.636071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.657091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:53.657213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:53.659091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.667667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.745080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 936/1862] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:53.755425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:53.758661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:53.759100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977c49d-0b4f-4785-b471-7604e1068325 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:53.759716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:53.763919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:53.768072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.768072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.768072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] PATH_INFO: `/v3/projects/62d9727da54341cf8ffc1ee2b2f8d960` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.768072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d9727da54341cf8ffc1ee2b2f8d960)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:53.768626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:53.820152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73503-b931-4a10-ba1f-1c99a8f37096 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:53.833331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:53.834076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:53.834493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:53.834881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:53.845979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:53.848025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:53.859335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 937/1863] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:54.009696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d9727da54341cf8ffc1ee2b2f8d960', 'request_id': 'req-1c27b840-b3cf-4919-b59f-fa012f2e747f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.112144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d9727da54341cf8ffc1ee2b2f8d960', 'request_id': 'req-1c27b840-b3cf-4919-b59f-fa012f2e747f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.119600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d9727da54341cf8ffc1ee2b2f8d960', 'request_id': 'req-1c27b840-b3cf-4919-b59f-fa012f2e747f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.139626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] The token cache is being invalidate because project 62d9727da54341cf8ffc1ee2b2f8d960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:54.139987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.140736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.142459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 927/1864] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:53 2022] DELETE /identity/v3/projects/62d9727da54341cf8ffc1ee2b2f8d960 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:54.148045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:54.157910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10242-5c06-448b-bcaa-daaa2936ce09 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:54.214808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:54.215703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:54.215993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:54.216275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] PATH_INFO: `/v3/users/4157e77ce8e34b9b93628775b3c5eb63` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:54.217487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4157e77ce8e34b9b93628775b3c5eb63)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:54.219568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:54.255834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:54.257456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:54.270621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27b840-b3cf-4919-b59f-fa012f2e747f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:54.276641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:54.277667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:54.277962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:54.278265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] PATH_INFO: `/v3/projects/55166a6f38f34525bb9da1ec9eea3292` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:54.279900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=55166a6f38f34525bb9da1ec9eea3292)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:54.281513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:54.436087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55166a6f38f34525bb9da1ec9eea3292', 'request_id': 'req-917c8dad-7f74-4868-83b0-860dd9eaf62c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.436385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4157e77ce8e34b9b93628775b3c5eb63'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.437087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4157e77ce8e34b9b93628775b3c5eb63'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.437877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4157e77ce8e34b9b93628775b3c5eb63'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.452088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4157e77ce8e34b9b93628775b3c5eb63'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.524049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55166a6f38f34525bb9da1ec9eea3292', 'request_id': 'req-917c8dad-7f74-4868-83b0-860dd9eaf62c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.532701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55166a6f38f34525bb9da1ec9eea3292', 'request_id': 'req-917c8dad-7f74-4868-83b0-860dd9eaf62c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.544151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] The token cache is being invalidate because project 55166a6f38f34525bb9da1ec9eea3292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:54.544522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.545294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.547242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 928/1865] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:54 2022] DELETE /identity/v3/projects/55166a6f38f34525bb9da1ec9eea3292 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:54.547979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:54.549360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:54.619271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8dad-7f74-4868-83b0-860dd9eaf62c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:54.625053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:54.625967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:54.626284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:54.626568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] PATH_INFO: `/v3/projects/2280f82cc9444b5fb2b141e922c5ccf1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:54.627774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2280f82cc9444b5fb2b141e922c5ccf1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:54.629734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:54.660418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4157e77ce8e34b9b93628775b3c5eb63'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.674352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 938/1866] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:54 2022] DELETE /identity/v3/users/4157e77ce8e34b9b93628775b3c5eb63 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:54.675502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:54.677156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:54.757228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa51a-e3f4-4516-a3e0-a49b86ab5ac6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:54.771786 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2280f82cc9444b5fb2b141e922c5ccf1', 'request_id': 'req-bfe92305-a483-4eee-a913-e396fb1e743c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.823954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:54.825086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:54.825377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:54.825662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] PATH_INFO: `/v3/users/913a70897a7449aba4a64af71ac5d001` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:54.826877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=913a70897a7449aba4a64af71ac5d001)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:54.828887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:54.848987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2280f82cc9444b5fb2b141e922c5ccf1', 'request_id': 'req-bfe92305-a483-4eee-a913-e396fb1e743c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.858367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2280f82cc9444b5fb2b141e922c5ccf1', 'request_id': 'req-bfe92305-a483-4eee-a913-e396fb1e743c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.875161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] The token cache is being invalidate because project 2280f82cc9444b5fb2b141e922c5ccf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:54.875392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.876143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:54.880784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 929/1867] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:54 2022] DELETE /identity/v3/projects/2280f82cc9444b5fb2b141e922c5ccf1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:54.882446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:54.883843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:54.913714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe92305-a483-4eee-a913-e396fb1e743c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:54.920178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:54.921136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:54.921544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:54.921932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] PATH_INFO: `/v3/users/cb83ab5a7611474584f640c0a9398386` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:54.923312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb83ab5a7611474584f640c0a9398386)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:54.925409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:55.069756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913a70897a7449aba4a64af71ac5d001'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.070559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913a70897a7449aba4a64af71ac5d001'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.071361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913a70897a7449aba4a64af71ac5d001'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.084317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913a70897a7449aba4a64af71ac5d001'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.139404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb83ab5a7611474584f640c0a9398386'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.139983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb83ab5a7611474584f640c0a9398386'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.180746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913a70897a7449aba4a64af71ac5d001'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.195456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 939/1868] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:54 2022] DELETE /identity/v3/users/913a70897a7449aba4a64af71ac5d001 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:55.269499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:55.271323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:55.300604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:55.325039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb83ab5a7611474584f640c0a9398386'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.334724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb83ab5a7611474584f640c0a9398386'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.335467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-734b83ed-6c64-499b-be09-07939e83a710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb83ab5a7611474584f640c0a9398386'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.355619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 930/1869] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:31:54 2022] DELETE /identity/v3/users/cb83ab5a7611474584f640c0a9398386 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:55.378090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87361f0-37cb-4220-a8a3-7d2c55156bef admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:55.441971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:55.442883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.443166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.443447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] PATH_INFO: `/v3/projects/45617a5007e2454eb7ffd14d69c31855` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.444718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45617a5007e2454eb7ffd14d69c31855)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:55.446691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:55.466969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:55.578059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45617a5007e2454eb7ffd14d69c31855', 'request_id': 'req-5f15368a-e7c5-459d-8720-69bc9eeb8123'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.623149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45617a5007e2454eb7ffd14d69c31855', 'request_id': 'req-5f15368a-e7c5-459d-8720-69bc9eeb8123'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.627260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45617a5007e2454eb7ffd14d69c31855', 'request_id': 'req-5f15368a-e7c5-459d-8720-69bc9eeb8123'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.645276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] The token cache is being invalidate because project 45617a5007e2454eb7ffd14d69c31855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:55.646045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.647182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5f15368a-e7c5-459d-8720-69bc9eeb8123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:55.649646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 940/1870] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:55 2022] DELETE /identity/v3/projects/45617a5007e2454eb7ffd14d69c31855 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:55.654137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.654459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.658805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.689738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:55.691640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:55.792175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 931/1871] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:55.802489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.804111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.806487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:55.808318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.827773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:55.829002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:55.837194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 941/1872] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:55.841437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:55.851036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:55.852885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:55.853880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e8b13-fe3b-4bba-996b-099e57a7a537 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:55.858757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:55.859437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.859723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.860141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.860884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:55.861194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:55.863152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:55.869254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597eb15-d8d8-4b60-979d-ec8e787dbbdb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:55.876631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:55.877821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.878310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.878742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] PATH_INFO: `/v3/projects/6973252a07e74e9794b43d0e259718b4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.880770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6973252a07e74e9794b43d0e259718b4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:55.883723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:55.887764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 932/1873] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:55.891399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:55.905736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a698-ed41-4c52-bda0-c3da0ca421a7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:55.911103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:55.911772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:55.912055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:55.912360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:55.913054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:55.915016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.002717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 933/1874] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:55 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:56.002717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.002717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.042016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6973252a07e74e9794b43d0e259718b4', 'request_id': 'req-d4f7bec9-a101-44fa-a604-2f6da062e9b0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.070172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441a9cf-bb98-4de7-bb03-6e97467016ce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.123706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.124555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.124948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.125228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] PATH_INFO: `/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.126425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a459b96aa274afb8c21b9fe9d23cc16)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.128467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.129357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6973252a07e74e9794b43d0e259718b4', 'request_id': 'req-d4f7bec9-a101-44fa-a604-2f6da062e9b0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.137193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6973252a07e74e9794b43d0e259718b4', 'request_id': 'req-d4f7bec9-a101-44fa-a604-2f6da062e9b0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.152930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] The token cache is being invalidate because project 6973252a07e74e9794b43d0e259718b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:56.153240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.154014 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.156042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 942/1875] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:55 2022] DELETE /identity/v3/projects/6973252a07e74e9794b43d0e259718b4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:56.156951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.158282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.172294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7bec9-a101-44fa-a604-2f6da062e9b0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.177122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.177825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.179715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.179715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.179715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.181801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040558-1d80-4f69-838a-fdb8e371d20f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.281091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 943/1876] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:56.281091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.281091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.281581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.289131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a459b96aa274afb8c21b9fe9d23cc16', 'request_id': 'req-b494858b-56bd-4a50-bbb2-e9f3767e0df1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.299721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:56.300943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.357731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a459b96aa274afb8c21b9fe9d23cc16', 'request_id': 'req-b494858b-56bd-4a50-bbb2-e9f3767e0df1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.360347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 944/1877] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:56.361203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.365066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a459b96aa274afb8c21b9fe9d23cc16', 'request_id': 'req-b494858b-56bd-4a50-bbb2-e9f3767e0df1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.371786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42b4a8-52fc-4471-9517-8b55ea534780 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.377081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.382905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.382905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.382905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.383149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] The token cache is being invalidate because project 4a459b96aa274afb8c21b9fe9d23cc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:31:56.383149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.383291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.383360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b494858b-56bd-4a50-bbb2-e9f3767e0df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:31:56.383427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843475d6-7536-4240-9fcc-2add0cc4e5fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.384455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 934/1878] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:31:55 2022] DELETE /identity/v3/projects/4a459b96aa274afb8c21b9fe9d23cc16 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:56.385960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809216-32fa-4596-9431-c4478e3f5885 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.386451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809216-32fa-4596-9431-c4478e3f5885 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.386927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809216-32fa-4596-9431-c4478e3f5885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.394773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 945/1879] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:56.396018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.396314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.396598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.416642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:56.417872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.427077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 946/1880] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:56.427881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.429641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.434278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f8809216-32fa-4596-9431-c4478e3f5885 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:56.435650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f8809216-32fa-4596-9431-c4478e3f5885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.443271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb997b-a3b4-4607-aba9-0700dfd1f399 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.449084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.449807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.450050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.450370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.451109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.452382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 935/1881] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:56.452738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.454422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.457618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.458150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.474844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 947/1882] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:56.474844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.486512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14de5-9820-49f2-8c06-0295368f4025 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.492601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:56.493300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.495006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.495679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.495970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.496291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.496979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:56.497294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.501907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.511013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 936/1883] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:56.512096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.515851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 948/1884] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:56.516699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.530455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e19a-15c7-49eb-b01c-33318e32efbd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.530590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a7be-039b-472d-b8c4-9fee18c0f97e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.532251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.533079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.533421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.533559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.533785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.534747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:31:56.534900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.535077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.535377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.535756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] PATH_INFO: `/v3/projects/ef14e79517fc4337a3740a7ee322a015/users/df86a233e3324897a3ca9fcd73679820/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.536799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.549938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 949/1885] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:31:56.550859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.560149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef14e79517fc4337a3740a7ee322a015, user_id=df86a233e3324897a3ca9fcd73679820, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.563639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.567785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d84aa-a315-4b75-9a6b-b21174c3372e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.579790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.580682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.580838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.581149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.581963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.583950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a48f3-468e-4719-a6d9-5a08766c5bb5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.628719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 937/1886] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:56 2022] PUT /identity/v3/projects/ef14e79517fc4337a3740a7ee322a015/users/df86a233e3324897a3ca9fcd73679820/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:56.629565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.688083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 950/1887] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:56.688083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.688083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.688083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.696759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45fec-5e0f-4377-8891-553b6553a610 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.704228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:56.705440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.756236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.756911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.757194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.757587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.758181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.760119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.768968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 951/1888] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:56.768968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.782163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07c182-2264-4732-a4db-3d0e4b441e54 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.788050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.788734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.789022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.789301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.790077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:56.792253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:56.929979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 938/1889] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:56.929979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.929979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:56.984066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 952/1890] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:56.987737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:56.991639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56c43-a9ae-4dbd-95a2-8b32bd3fca69 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:56.995874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:56.996540 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:56.996828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:56.997111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:56.998092 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beacf9-bc81-4eb1-9ef7-6d0e07e3e90a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.029074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:57.061039 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.061794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.062063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.062393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.063093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.065250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.072892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.074582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.085686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 939/1891] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:57.093119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.097417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242942-f7ee-4df5-8ac8-3a2c02f2346e service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.102366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.103209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.103352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.103657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.104420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.106053 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.125316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 940/1892] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:57.125316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.132000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbb071-5dcb-4ab2-9105-b2bc4337cadd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.136836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.137501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.137788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.138068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.138826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.140783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.151121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 941/1893] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:57.167755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 953/1894] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:56 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:57.171222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.171673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.182115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bb4b-7a91-43cb-b479-914b6c820317 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.182456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f264e3-8d4c-4375-a769-acc85de4ed62 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.187122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.187446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.187791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.188080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.188332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.188432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.188622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.188906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] PATH_INFO: `/v3/projects/f51110b0dac548928aa05205cff4fc15/users/5f9b106961b04604a963984181a50370/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.189111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.190846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.201555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 954/1895] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:57.209458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51110b0dac548928aa05205cff4fc15, user_id=5f9b106961b04604a963984181a50370, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.209458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf060e99-94f2-4017-93b9-364f79e58e67 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.212359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.222658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61cf3-1623-4678-ace8-c7956bb3af1a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.228077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.228786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.229072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.229353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.230167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.231843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.244873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 955/1896] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:57.249011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.259328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426dd2b-69c4-4a43-9b4e-b09c5d4ac4f5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.265175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.265175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.265371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.265483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] PATH_INFO: `/v3/projects/5e8b194088be46a99f49a9b7e6e77739/users/1c31d27b6ccf46a8a7368b0f7095e2c1/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.279818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8b194088be46a99f49a9b7e6e77739, user_id=1c31d27b6ccf46a8a7368b0f7095e2c1, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.282494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fa052-f85b-4e40-865a-d11f0e957825 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.454088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 942/1897] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:57 2022] PUT /identity/v3/projects/f51110b0dac548928aa05205cff4fc15/users/5f9b106961b04604a963984181a50370/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:57.459876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.460238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.460455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.492798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] MFA Rules not processed for user `5f9b106961b04604a963984181a50370`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:57.494024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:57.539102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 956/1898] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:57 2022] PUT /identity/v3/projects/5e8b194088be46a99f49a9b7e6e77739/users/1c31d27b6ccf46a8a7368b0f7095e2c1/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:57.555076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.555458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.555823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.589642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 943/1899] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:57.589842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] MFA Rules not processed for user `1c31d27b6ccf46a8a7368b0f7095e2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:57.589842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:57.590878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.705283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d3f5-429c-402d-a46a-634b0723894c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.715111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:57.725281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 957/1900] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:57.726830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:57.813204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.813954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.814267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.814554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.815314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.817322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:57.844683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd7f8-54c7-4c24-91a6-cdcb0b4e9a3e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:57.850064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:57.850938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:57.854027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:57.854027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:57.854027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:57.855103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.005626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 944/1901] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:57 2022] POST /identity/v3/projects => generated 369 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:58.010398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 958/1902] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:57 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:58.011760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.014795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.032361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:58.111884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e6ed-5384-4f4d-a9ab-699ba126b72e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.123507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.124333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.124641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.124977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.126027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.130478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35672-6e5c-40bb-8995-a9b76730f8d5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.136413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.137374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.138669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.138961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.139820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.142083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.142223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.283988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 959/1903] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:58.288193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 945/1904] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:58.289499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.289619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.300338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488443-2de6-4e15-b5b7-a23c98dad587 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.301032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410875-6edc-4aa6-a5e1-050f60884882 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.305622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.306342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.306547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.306685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.307028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.307190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.307455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.307739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.307833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.308478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.309508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.310437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.321753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 946/1905] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:58.325195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 960/1906] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:58.325823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.326178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.337109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3791-68f9-417e-b688-bc73fc6eff7e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.339432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46dc1-5ae7-47d7-9874-bee160ee0cf2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.342910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.343948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.344656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.344656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] PATH_INFO: `/v3/projects/6089b44e315e4b909aace9945a46ebbe/users/d500be8fe0b8466d881bc3aa2a38e6b6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.346510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.348327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.348614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.358986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] PATH_INFO: `/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0/users/e14abc4a02694e94ac9f09c103dbd637/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.365592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6089b44e315e4b909aace9945a46ebbe, user_id=d500be8fe0b8466d881bc3aa2a38e6b6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.368921 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.372562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2d74ecfeb14c58ad5c3c43a90cf6f0, user_id=e14abc4a02694e94ac9f09c103dbd637, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.375378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.455065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 961/1907] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:58 2022] PUT /identity/v3/projects/6089b44e315e4b909aace9945a46ebbe/users/d500be8fe0b8466d881bc3aa2a38e6b6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:58.456580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 947/1908] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:58 2022] PUT /identity/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0/users/e14abc4a02694e94ac9f09c103dbd637/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:58.460008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.461323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.526996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780752f-68e3-43c3-a9a3-1aa34f059c4c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.531842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.532525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.532836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.533105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.533841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.534033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac8f8-6afa-44e0-aebb-c0e6dda887f4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.535504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.539814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.540491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.540781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.541087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.541857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.543567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.547544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 948/1909] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:58.554087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.561129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 962/1910] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:58.562325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2636-0b22-4181-ae98-70ebf40b3b9b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.565153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.569177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.576609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.576609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.576609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] PATH_INFO: `/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0/users/e14abc4a02694e94ac9f09c103dbd637/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.576609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2d74ecfeb14c58ad5c3c43a90cf6f0, user_id=e14abc4a02694e94ac9f09c103dbd637, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.576609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceec8dd-2a44-4804-b6d7-625e3a97987d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.579010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf58789-a8ba-4d6d-97a1-63a6b21765f9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.585729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.586683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.587008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.587136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 949/1911] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:58 2022] PUT /identity/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0/users/e14abc4a02694e94ac9f09c103dbd637/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:58.587341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] PATH_INFO: `/v3/projects/6089b44e315e4b909aace9945a46ebbe/users/d500be8fe0b8466d881bc3aa2a38e6b6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.590148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6089b44e315e4b909aace9945a46ebbe, user_id=d500be8fe0b8466d881bc3aa2a38e6b6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.602330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.602330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.602330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.602617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b863-2358-49b3-b9b1-e2d2ee693f18 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.613235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 963/1912] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:58 2022] PUT /identity/v3/projects/6089b44e315e4b909aace9945a46ebbe/users/d500be8fe0b8466d881bc3aa2a38e6b6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:31:58.625430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.625718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.626001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.628962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] MFA Rules not processed for user `e14abc4a02694e94ac9f09c103dbd637`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:58.630559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:58.654488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] MFA Rules not processed for user `d500be8fe0b8466d881bc3aa2a38e6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:58.655701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:58.707033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 950/1913] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:58.719131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.721182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:58.737334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 964/1914] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:31:58.745939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.747569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:58.802604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb4999-c782-44ea-aa2a-769f67959c44 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.807245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.808172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.808513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.808781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.820977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.822942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56fe47-4e59-49a6-8cf4-df6ecb13bb6d service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.828846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc901521-893a-4f2d-86af-293674b09a46 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:58.833583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:58.834656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.834912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.835204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.844488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 951/1915] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:58.849993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:58.849993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:58.849993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:58.850278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:58.850278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:58.871209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 965/1916] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:58.875862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] MFA Rules not processed for user `df86a233e3324897a3ca9fcd73679820`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:31:58.877080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:31:58.944652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 952/1917] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:31:58.949200 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.983272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:58.998603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c87baf-fc90-4995-b310-30d75eccfb46 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.003490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.004196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.004486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.005130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.075640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3101a-fc1c-4d53-922f-e0139e03fba3 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.081726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.082631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.083064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.084596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.085534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.087990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.105820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.109459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.121065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 953/1918] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:31:59.245912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 966/1919] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:31:58 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:31:59.248028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.264865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1ca2-50ec-4e0c-8d49-06d5e7e5251c service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.274478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.342634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.343306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.343588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.343864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.344556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.346516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.355569 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cbb9-cc58-4aad-9aac-7ee1c59380d5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.359687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.360435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.360766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.361178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.424097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.425708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.437650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 967/1920] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:31:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:31:59.466587 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:59.573016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 954/1921] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:31:59 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:31:59.573970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.586116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13445f0e-3f5c-4031-9052-83d5eecffb0f service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.590926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.591635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.591925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.592214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.592953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.594609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.605504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 968/1922] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:31:59.609831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.621163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb788d4-9297-45ab-8639-9090dd2c230b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.625938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.626944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.630947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.630947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] PATH_INFO: `/v3/projects/eb4a2c038d73479f9238fdb796821634/users/ca75741ac2ab4071be45b0c778f4c173/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.643278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a2c038d73479f9238fdb796821634, user_id=ca75741ac2ab4071be45b0c778f4c173, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.646051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.735232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 955/1923] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:59 2022] PUT /identity/v3/projects/eb4a2c038d73479f9238fdb796821634/users/ca75741ac2ab4071be45b0c778f4c173/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:31:59.739178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.749963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9a96-8269-41a2-9867-06a36c1f382f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.807997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.808670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.808963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.809382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.810127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.812593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065fe33-2269-472c-919b-11ac2dcd4983 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.832458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 969/1924] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:31:59.833089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:31:59.839855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8eba1-d5c8-4757-bf9b-a1364c68d545 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:31:59.856419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:31:59.856419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:31:59.856419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:31:59.856419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] PATH_INFO: `/v3/projects/eb4a2c038d73479f9238fdb796821634/users/ca75741ac2ab4071be45b0c778f4c173/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:31:59.856757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a2c038d73479f9238fdb796821634, user_id=ca75741ac2ab4071be45b0c778f4c173, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:31:59.860119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd4210-090d-4492-a0d3-32b80d681f2e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:31:59.876810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 956/1925] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:31:59 2022] PUT /identity/v3/projects/eb4a2c038d73479f9238fdb796821634/users/ca75741ac2ab4071be45b0c778f4c173/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:00.089130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:00.416119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:00.417158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:00.417538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:00.423379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 970/1926] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:32:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:32:00.437862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31098d-9314-45bb-a845-3717dc0af7e3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:00.438341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31098d-9314-45bb-a845-3717dc0af7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:00.439569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31098d-9314-45bb-a845-3717dc0af7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:00.469895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-da31098d-9314-45bb-a845-3717dc0af7e3 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:00.471189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-da31098d-9314-45bb-a845-3717dc0af7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:00.629316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 957/1927] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:32:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:00.801435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:00.804978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:00.828087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7fe11-f5f3-4467-828e-57d76a59061d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:00.832257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:00.832972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:00.833312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:00.833595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:00.876044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:00.880005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc132c0-259f-4ff5-b35d-cf39bd2adca6 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:00.909154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 971/1928] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:01.328976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:01.780407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:01.781079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:01.781079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:01.849072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] MFA Rules not processed for user `ca75741ac2ab4071be45b0c778f4c173`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:01.851005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:01.985641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 958/1929] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:01.990411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:01.991339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:01.991746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:02.031518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] MFA Rules not processed for user `df86a233e3324897a3ca9fcd73679820`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:02.032759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:02.116009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 972/1930] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:02.129550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:02.133044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:02.151156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a91c68-704a-41ac-a393-d9864325cb4a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:02.156988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:02.157980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:02.158299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:02.158677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:02.169843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:02.171684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aaf79-6f40-44b3-8a64-d76234e5b9e2 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:02.194849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 959/1931] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:02.197894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:05.215570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:05.831796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:05.894719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972f2dd-1f51-4a7a-b747-8cb04bbe7fb9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:05.898670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:05.901409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:05.902304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:05.902592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:05.902893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] PATH_INFO: `/v3/users/5f9b106961b04604a963984181a50370` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:05.905010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9b106961b04604a963984181a50370)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:05.906089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:06.135050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9b106961b04604a963984181a50370'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:06.136091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9b106961b04604a963984181a50370'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:06.137099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9b106961b04604a963984181a50370'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:06.157185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9b106961b04604a963984181a50370'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:06.305802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9b106961b04604a963984181a50370'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:06.319745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 973/1932] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:05 2022] DELETE /identity/v3/users/5f9b106961b04604a963984181a50370 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:06.324294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066238-ec03-4323-bf08-c4c435299298 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:06.324848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066238-ec03-4323-bf08-c4c435299298 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:06.324848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066238-ec03-4323-bf08-c4c435299298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:06.343371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-98066238-ec03-4323-bf08-c4c435299298 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:06.344597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-98066238-ec03-4323-bf08-c4c435299298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:06.404927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 960/1933] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:06.414878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:06.417041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:06.492548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b582-e78d-452b-b940-79adca6cd067 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:06.497795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:06.498667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:06.499106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:06.499602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:06.519637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:06.521284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:06.536170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 974/1934] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:07.078771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:07.090863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98066238-ec03-4323-bf08-c4c435299298 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:07.092354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-98066238-ec03-4323-bf08-c4c435299298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:07.108353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98066238-ec03-4323-bf08-c4c435299298 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:07.115456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:07.117951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:07.117951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:07.117951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] PATH_INFO: `/v3/projects/f51110b0dac548928aa05205cff4fc15` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:07.117951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51110b0dac548928aa05205cff4fc15)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:07.120463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:07.386104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51110b0dac548928aa05205cff4fc15', 'request_id': 'req-25d588d9-7f5e-4e5c-ae78-c642b1626175'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.471335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51110b0dac548928aa05205cff4fc15', 'request_id': 'req-25d588d9-7f5e-4e5c-ae78-c642b1626175'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.479904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51110b0dac548928aa05205cff4fc15', 'request_id': 'req-25d588d9-7f5e-4e5c-ae78-c642b1626175'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.492230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] The token cache is being invalidate because project f51110b0dac548928aa05205cff4fc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:07.492864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.493885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.496648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 961/1935] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:07 2022] DELETE /identity/v3/projects/f51110b0dac548928aa05205cff4fc15 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:07.500689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:07.515626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835e976-167c-4d08-8488-17380da75ccd service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:07.608372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:07.612337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:07.612337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:07.612337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] PATH_INFO: `/v3/users/e14abc4a02694e94ac9f09c103dbd637` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:07.613340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14abc4a02694e94ac9f09c103dbd637)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:07.617035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:07.905990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14abc4a02694e94ac9f09c103dbd637'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.908773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14abc4a02694e94ac9f09c103dbd637'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.908773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14abc4a02694e94ac9f09c103dbd637'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:07.932070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14abc4a02694e94ac9f09c103dbd637'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.027018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:08.028512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:08.042916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d588d9-7f5e-4e5c-ae78-c642b1626175 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:08.048880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14abc4a02694e94ac9f09c103dbd637'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.050537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:08.054633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.055112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.058737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] PATH_INFO: `/v3/users/88e0c06ab3c4434c93890c5cda9cde5e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.058737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e0c06ab3c4434c93890c5cda9cde5e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:08.060428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:08.081288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 975/1936] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:07 2022] DELETE /identity/v3/users/e14abc4a02694e94ac9f09c103dbd637 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:08.116661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:08.118433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:08.252040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde22b-4b57-4d6e-ac20-721b73acd97f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:08.258371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:08.259718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.260203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.260648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] PATH_INFO: `/v3/users/1c31d27b6ccf46a8a7368b0f7095e2c1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.262094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c31d27b6ccf46a8a7368b0f7095e2c1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:08.264364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:08.323790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:08.340425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e0c06ab3c4434c93890c5cda9cde5e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.341374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e0c06ab3c4434c93890c5cda9cde5e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.449387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e0c06ab3c4434c93890c5cda9cde5e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.475665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c31d27b6ccf46a8a7368b0f7095e2c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.476567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c31d27b6ccf46a8a7368b0f7095e2c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.477277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c31d27b6ccf46a8a7368b0f7095e2c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.480451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e0c06ab3c4434c93890c5cda9cde5e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.483044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37ba12b-5ff1-461c-9102-d46a06c830e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e0c06ab3c4434c93890c5cda9cde5e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.492507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c31d27b6ccf46a8a7368b0f7095e2c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.512083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 962/1937] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:08 2022] DELETE /identity/v3/users/88e0c06ab3c4434c93890c5cda9cde5e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:08.517476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.517839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.518228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.547610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:08.549796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:08.551189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:08.608766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e336bcbb-f797-429b-9bdf-c98d2bf73152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c31d27b6ccf46a8a7368b0f7095e2c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:08.630102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 976/1938] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:08 2022] DELETE /identity/v3/users/1c31d27b6ccf46a8a7368b0f7095e2c1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:08.636680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.637173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.637968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.640868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 963/1939] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:08.664963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:08.666313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:08.680288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:08.682901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:08.803565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 977/1940] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:08.805013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd958a-5d24-4882-adc1-9afd433dbb45 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:08.828244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:08.896410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:08.897516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.899490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.900323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.916823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:08.920326 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:08.954335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 964/1941] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:08.959278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80c796-b41e-47ca-a5db-71e87c01d96d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:08.972075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:08.972755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:08.973044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:08.973324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:08.985029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:08.986697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797a150-ff9d-4e8d-bdc3-acf75237306b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:08.998578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 978/1942] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:09.706783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:09.708633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:09.725990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668820ba-de5c-4f7b-935d-07684c388f4d service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:09.731598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:09.733144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:09.733598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:09.734280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] PATH_INFO: `/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:09.736986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2d74ecfeb14c58ad5c3c43a90cf6f0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:09.739553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:09.898713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2d74ecfeb14c58ad5c3c43a90cf6f0', 'request_id': 'req-3311ed1f-bf40-4a57-9037-e51621127bf0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:09.980190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2d74ecfeb14c58ad5c3c43a90cf6f0', 'request_id': 'req-3311ed1f-bf40-4a57-9037-e51621127bf0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:09.987476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2d74ecfeb14c58ad5c3c43a90cf6f0', 'request_id': 'req-3311ed1f-bf40-4a57-9037-e51621127bf0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:10.000787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] The token cache is being invalidate because project 2f2d74ecfeb14c58ad5c3c43a90cf6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:10.001515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:10.002405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3311ed1f-bf40-4a57-9037-e51621127bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:10.004534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 965/1943] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:09 2022] DELETE /identity/v3/projects/2f2d74ecfeb14c58ad5c3c43a90cf6f0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:10.009799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.010874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.014291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.032936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:10.034625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:10.119739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 979/1944] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:10.128814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.129605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.130302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.157966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:10.159940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:10.173645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 966/1945] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:10.178662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.189306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f2ee-30ec-4e17-862a-e6f94346aa34 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.195437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.196270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.196631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.196980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.197874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:10.198216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.200114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:10.214869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 980/1946] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:10.219074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.230297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf71b6-451f-4d60-a518-9915d915b71f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.239070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.240597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.241080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.241604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.242731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.245478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:10.370096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 967/1947] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:10 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:10.374722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.410734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d854300-3e5e-42c7-8b7c-07dc85c1403c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.438029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:10.482868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:10.576962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.577665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.577920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.578219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.580030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.581278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:10.759591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 981/1948] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:10 2022] POST /identity/v3/users => generated 292 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:10.763789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.779789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae3306-f677-4839-8686-4a6df18a53d3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.797225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.798040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.798447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.798822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.799730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.801403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:10.831696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 968/1949] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:10.835696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.845972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e227c03-3576-4b31-b5d3-650617228e4c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.851666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.852460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.852843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.853199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.854031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.855836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea292b-c1fa-41f6-91b5-6ebbe2782e0f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:10.876275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 982/1950] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:10.880574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:10.891005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cda39b-61a3-4bcc-bcb6-358a443073bc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:10.897502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:10.898809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:10.899279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:10.899711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] PATH_INFO: `/v3/projects/b33a22c204d64f7e9edca393cb543a5a/users/1267347697f44e329edfe65e9a272eaa/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:10.923050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33a22c204d64f7e9edca393cb543a5a, user_id=1267347697f44e329edfe65e9a272eaa, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:10.928804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:11.105000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 969/1951] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:10 2022] PUT /identity/v3/projects/b33a22c204d64f7e9edca393cb543a5a/users/1267347697f44e329edfe65e9a272eaa/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:11.117381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:11.118317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:11.118778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:11.139256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:11.142496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:11.197497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] MFA Rules not processed for user `1267347697f44e329edfe65e9a272eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:11.204400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:11.328319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e850-39d3-4312-9616-ef236a0c951d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:11.340993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:11.342179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:11.342717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:11.343249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] PATH_INFO: `/v3/projects/68dd544746a4420087e1fec451e2e63e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:11.344739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dd544746a4420087e1fec451e2e63e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:11.348367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:11.353890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 983/1952] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:11.358761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:11.360087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:11.396523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614071b7-c88b-4e76-b421-1d3724dea870 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:11.411715 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:11.413751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:11.414403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:11.414893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] PATH_INFO: `/v3/projects/5e8b194088be46a99f49a9b7e6e77739` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:11.416680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8b194088be46a99f49a9b7e6e77739)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:11.419066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:11.593969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dd544746a4420087e1fec451e2e63e', 'request_id': 'req-32474ece-4d8a-490c-9f4c-de45e600da94'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.635382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8b194088be46a99f49a9b7e6e77739', 'request_id': 'req-a0f38aec-dc30-4886-9672-3b0507e33f5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.704262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dd544746a4420087e1fec451e2e63e', 'request_id': 'req-32474ece-4d8a-490c-9f4c-de45e600da94'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.717761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dd544746a4420087e1fec451e2e63e', 'request_id': 'req-32474ece-4d8a-490c-9f4c-de45e600da94'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.734565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] The token cache is being invalidate because project 68dd544746a4420087e1fec451e2e63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:11.738405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.738405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.738405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 970/1953] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:11 2022] DELETE /identity/v3/projects/68dd544746a4420087e1fec451e2e63e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:11.739202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:11.741441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:11.768284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8b194088be46a99f49a9b7e6e77739', 'request_id': 'req-a0f38aec-dc30-4886-9672-3b0507e33f5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.775216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8b194088be46a99f49a9b7e6e77739', 'request_id': 'req-a0f38aec-dc30-4886-9672-3b0507e33f5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.816854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] The token cache is being invalidate because project 5e8b194088be46a99f49a9b7e6e77739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:11.824509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.827332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474ece-4d8a-490c-9f4c-de45e600da94 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:11.828181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:11.830351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 984/1954] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:11 2022] DELETE /identity/v3/projects/5e8b194088be46a99f49a9b7e6e77739 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:11.835122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:11.845521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:11.966625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:11.967570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:11.968060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:11.971269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:11.971555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38aec-dc30-4886-9672-3b0507e33f5d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:11.975011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:11.978702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:11.984793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:11.985689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:11.986171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:11.986493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] PATH_INFO: `/v3/users/404864e8c91a4bcdb3ac02d2e0f74f30` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:11.988384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404864e8c91a4bcdb3ac02d2e0f74f30)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:11.992372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:12.170880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 971/1955] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:11 2022] POST /identity/v3/projects => generated 387 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:12.178049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:12.190635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:12.248154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404864e8c91a4bcdb3ac02d2e0f74f30'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.248861 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404864e8c91a4bcdb3ac02d2e0f74f30'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.250140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404864e8c91a4bcdb3ac02d2e0f74f30'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.281257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404864e8c91a4bcdb3ac02d2e0f74f30'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.373224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efcad-388a-4773-a5f4-871d3c895fa7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:12.389948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:12.389948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:12.389948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:12.389948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] PATH_INFO: `/v3/users/d500be8fe0b8466d881bc3aa2a38e6b6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:12.390447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d500be8fe0b8466d881bc3aa2a38e6b6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:12.396237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:12.431116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404864e8c91a4bcdb3ac02d2e0f74f30'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.466757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 985/1956] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:11 2022] DELETE /identity/v3/users/404864e8c91a4bcdb3ac02d2e0f74f30 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:12.467911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:12.478038 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:12.589873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f05f1-1d3c-4243-a979-786e989227f2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:12.597749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:12.599130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:12.600089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:12.600465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:12.601386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:12.603493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:12.663026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd500be8fe0b8466d881bc3aa2a38e6b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.663954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd500be8fe0b8466d881bc3aa2a38e6b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.680093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 986/1957] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:12 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:12.681282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:12.683116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:12.719015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a00d1-5cec-467e-ac86-96ef0422ce59 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:12.722878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd500be8fe0b8466d881bc3aa2a38e6b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.733206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd500be8fe0b8466d881bc3aa2a38e6b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.734474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd500be8fe0b8466d881bc3aa2a38e6b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:12.741926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:12.742672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:12.742962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:12.743241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:12.747328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:12.749545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:12.777482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 972/1958] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:12 2022] DELETE /identity/v3/users/d500be8fe0b8466d881bc3aa2a38e6b6 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:12.799233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 987/1959] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:12.800631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:12.831567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:12.860342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:12.920508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e8fe-4889-47c7-b6d9-6a56298c5135 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:12.925690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:12.926502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:12.927047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:12.927330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:12.928332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:12.930219 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:12.947205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 973/1960] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:12.947845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:12.959184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa95e3-757d-4034-845f-452f0fb769e5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:12.964642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:12.965579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:12.966018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:12.966395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] PATH_INFO: `/v3/projects/b43d3838744342e29ac444426135b6b0/users/ce1376c0adb24ede8548b212e1b42c40/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:12.982539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43d3838744342e29ac444426135b6b0, user_id=ce1376c0adb24ede8548b212e1b42c40, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:12.985220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539965-ec70-43a9-b3d1-a0fd7744fb46 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.022108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.022108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.028261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a793a9-6172-4919-845c-cb2cc2d1d665 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.034389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.039141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.039511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.039869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] PATH_INFO: `/v3/projects/efa0fdc645f2495e87107a02e1e411a2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.041749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa0fdc645f2495e87107a02e1e411a2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.052407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.081252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 988/1961] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:12 2022] PUT /identity/v3/projects/b43d3838744342e29ac444426135b6b0/users/ce1376c0adb24ede8548b212e1b42c40/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:13.092098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.092666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.092958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.127863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] MFA Rules not processed for user `ce1376c0adb24ede8548b212e1b42c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:13.129077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.198299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 989/1962] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:13.202976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.227208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa0fdc645f2495e87107a02e1e411a2', 'request_id': 'req-7edb123f-f910-474a-8dbd-97e5ce60bd0b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.267493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544637-6208-4eea-aa6e-464acac7ff7b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.327579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.328251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.328541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.328825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.329528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.331487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.368230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa0fdc645f2495e87107a02e1e411a2', 'request_id': 'req-7edb123f-f910-474a-8dbd-97e5ce60bd0b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.376338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa0fdc645f2495e87107a02e1e411a2', 'request_id': 'req-7edb123f-f910-474a-8dbd-97e5ce60bd0b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.388373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] The token cache is being invalidate because project efa0fdc645f2495e87107a02e1e411a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:13.388761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.389633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7edb123f-f910-474a-8dbd-97e5ce60bd0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.391930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 974/1963] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:12 2022] DELETE /identity/v3/projects/efa0fdc645f2495e87107a02e1e411a2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:13.397111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed024-053e-44ee-83fa-824ed748de72 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.397409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed024-053e-44ee-83fa-824ed748de72 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.397693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ed024-053e-44ee-83fa-824ed748de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.427765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d47ed024-053e-44ee-83fa-824ed748de72 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:13.428991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d47ed024-053e-44ee-83fa-824ed748de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.437697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 975/1964] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:13.446858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.447030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 990/1965] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:13.448427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.450273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.451675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.453294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.469782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:13.471063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.521307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f21a-7e7a-4799-b1f8-9bb552f73f22 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.526369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.527239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.529294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.529294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.529294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.530435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.557280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 976/1966] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:13.557280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.561787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.576621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63feda0-3709-4aa2-a4d4-39816a1ac6bd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.584561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.585552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.585906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.586285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] PATH_INFO: `/v3/projects/6089b44e315e4b909aace9945a46ebbe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.587735 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6089b44e315e4b909aace9945a46ebbe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.590453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.640593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 991/1967] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:13.640593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.649855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99ea86-4886-4309-824b-61827b71c012 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.655765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.656785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.657256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.657717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.658666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:13.659162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.661082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.676707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 992/1968] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:13.678438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.691885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157301ec-8da2-4b91-a1c4-bd6de60f3151 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.698342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.699359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.699826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.700477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.701539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.703417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.719840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 993/1969] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:13.731293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.731461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6089b44e315e4b909aace9945a46ebbe', 'request_id': 'req-0c6ce279-f621-46f0-abdf-92c14e80f594'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.763766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd84f9-2766-4613-8c7e-893fb78b887a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.811514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6089b44e315e4b909aace9945a46ebbe', 'request_id': 'req-0c6ce279-f621-46f0-abdf-92c14e80f594'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.837241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6089b44e315e4b909aace9945a46ebbe', 'request_id': 'req-0c6ce279-f621-46f0-abdf-92c14e80f594'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.869619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] The token cache is being invalidate because project 6089b44e315e4b909aace9945a46ebbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:13.870296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.871432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:13.879802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.880895 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.881231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.881520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.882247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.884304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf9394-ef82-4d6f-a730-c2a408e3a85b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:13.890283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 977/1970] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:13 2022] DELETE /identity/v3/projects/6089b44e315e4b909aace9945a46ebbe => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:13.891489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:13.893195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:13.906815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ce279-f621-46f0-abdf-92c14e80f594 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:13.912205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:13.913110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:13.918366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:13.918366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] PATH_INFO: `/v3/projects/50c42b00f82343479cb58b2b11cae63e/users/03aaa4b4469047a28ae2a699be90195e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:13.930043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c42b00f82343479cb58b2b11cae63e, user_id=03aaa4b4469047a28ae2a699be90195e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:13.932862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.049749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 994/1971] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:13 2022] POST /identity/v3/projects => generated 377 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:14.051629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.052118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.052767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.073251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:14.074617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.114343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 978/1972] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:13 2022] PUT /identity/v3/projects/50c42b00f82343479cb58b2b11cae63e/users/03aaa4b4469047a28ae2a699be90195e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:14.119395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.122252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.188184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 995/1973] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:14.188184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.201141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5b32-8bef-4c59-b063-3ecb7d5b15b1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.222662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a9b6-15be-4bec-9eba-4daf3e87f82c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.228667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.229894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.235201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.235201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.235201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.235201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.296229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.296931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.297201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.297746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.298546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.300180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41bc3-2d9c-4d55-b73f-94b8d649468e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.311821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 996/1974] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:14.316438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.316773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.317028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.341864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:14.342686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 979/1975] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:14.346714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.348714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.356697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 997/1976] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:14.357704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.370586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256762-0381-4a06-9f5e-57a01d57cc17 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.370817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70deb9-8d98-484e-b9fc-136e0e8ae7a3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.377441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.377833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.378429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.378429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.378607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.378683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.378762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.378762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] PATH_INFO: `/v3/projects/50c42b00f82343479cb58b2b11cae63e/users/03aaa4b4469047a28ae2a699be90195e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.378888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.380305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.380899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c42b00f82343479cb58b2b11cae63e, user_id=03aaa4b4469047a28ae2a699be90195e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.383803 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.395033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 998/1977] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:14.395033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.402093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 980/1978] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:14 2022] PUT /identity/v3/projects/50c42b00f82343479cb58b2b11cae63e/users/03aaa4b4469047a28ae2a699be90195e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:14.409103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.409238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d62c42-55b7-4406-a5f2-68d918c820ae admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.469984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.470946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.471242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.471524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.472325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:14.472641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.475088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704d6a-b6fd-4b4c-b1ee-0f9f8add1d65 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.490406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 999/1979] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:14.490406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.490406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.490867 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.496592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447832-c8b0-48c1-9ea0-1ab6e8ed556a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.501950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.502848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.503250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.503537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.504280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.506463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.518354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 981/1980] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:14.519287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.525325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] MFA Rules not processed for user `03aaa4b4469047a28ae2a699be90195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:14.526599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.530853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131409d2-0486-458f-999d-98acacce6f82 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.536301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.537454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.537746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.538171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.538904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.540834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.599749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 982/1981] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:14.600763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.606954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1000/1982] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:14.608020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.624949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26befbc-63bc-4e52-a9e5-710c72ba123c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.677574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262487e5-c09b-4956-938a-ee561d446699 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.682344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.683249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.683532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.683805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] PATH_INFO: `/v3/projects/ba55ad93d5aa4e209e180a0de55b61b1/users/fa4f363aebae422c855a97f05d4c3d6a/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.694523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.695195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.695476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.695750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.696619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.698656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.701106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba55ad93d5aa4e209e180a0de55b61b1, user_id=fa4f363aebae422c855a97f05d4c3d6a, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.706071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.775208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1001/1983] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:14.776191 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.778292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.787083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 983/1984] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:14 2022] PUT /identity/v3/projects/ba55ad93d5aa4e209e180a0de55b61b1/users/fa4f363aebae422c855a97f05d4c3d6a/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:14.787878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:14.847330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc09b-f13b-4196-b100-fe08ac4c0145 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.866962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3fc2-6c9b-4e66-b92c-bdd326381316 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:14.874047 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.875044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.875346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.875619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.876358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:14.878623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c817-11d4-463a-8955-cc1cdbb4651c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:14.903979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 984/1985] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:14.903979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.903979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.905938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.925040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:14.925778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:14.926024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:14.926470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:14.939999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:14.972910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] MFA Rules not processed for user `fa4f363aebae422c855a97f05d4c3d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:14.975949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:14.992158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:15.058780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.063588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.076883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1002/1986] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:15.077753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.089961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435be29-a570-44b0-828e-8f6629b80d5e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.095901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.096677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.096951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 985/1987] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:15.097077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.097360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.098102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.099798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.101604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.113298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1003/1988] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:15.116126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf7d37-a9bc-4061-9164-bb704545a372 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.117761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.129499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6072-5449-477e-8828-7c1b567d5d65 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.134456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.135015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.135641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.135919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.136210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.136493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] PATH_INFO: `/v3/projects/f3706d89aaac4b0eb255173df5d7a48e/users/5e55fa5b9aee40a4a4cd5a402521f5c9/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.136826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.137364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.138285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.141724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.159494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3706d89aaac4b0eb255173df5d7a48e, user_id=5e55fa5b9aee40a4a4cd5a402521f5c9, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.162502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1ecd-8a02-44a1-b6ed-e75e119b5783 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.249798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 986/1989] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:15.254075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.272732 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1004/1990] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:15 2022] PUT /identity/v3/projects/f3706d89aaac4b0eb255173df5d7a48e/users/5e55fa5b9aee40a4a4cd5a402521f5c9/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:15.283197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.283721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.284004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.316238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] MFA Rules not processed for user `5e55fa5b9aee40a4a4cd5a402521f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:15.318119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:15.321646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04b08-451e-48c1-ae6d-9d3505808c20 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.393579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.394305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.394597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.394879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.395572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.397347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1005/1991] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:15.397956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.406071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.419634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c3af-5cec-4787-b449-ebf3fb49d9c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.424968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.425457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.425751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.426035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.426844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.429925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.484607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 987/1992] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:15.485720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.512480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d92ed-7ef4-4d9e-a71a-1b84645edc29 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.528601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.529312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.529602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.530022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.530876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.532476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.548290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1006/1993] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:15.553707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.554439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 988/1994] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:15.555392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.572703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2cb9-bab9-471f-8add-b2f310972924 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.647943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cd4fe-15af-487f-b265-69f92b54b3c2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.653844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.655031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.655443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.655926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.656824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.659377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.661035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.664537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.664537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.664537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.664537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.666089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.679033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 989/1995] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:15.682960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.697226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641aa21-6f33-499f-81c1-6981ad6f23b8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.704335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.705484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.705767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.706051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] PATH_INFO: `/v3/projects/2ecc1b6992da47669c433fd33be02ae6/users/66fc62ea53fa4744adfd924c261dc015/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.730657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecc1b6992da47669c433fd33be02ae6, user_id=66fc62ea53fa4744adfd924c261dc015, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.733494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dfd86-ff6b-4c56-b0fc-c33d923442b6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.734470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1007/1996] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:15.738332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.754565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79aa09-7feb-497f-a892-c5eb5ccce8a8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.760137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.760961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.761441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.761790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.762696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.764393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.776321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1008/1997] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:15.780476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.791084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cc84a-c032-4032-9ccc-f43afe3dafd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.795788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.799577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.799577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.799577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] PATH_INFO: `/v3/projects/115b82c75969416b959d467c38a655d9/users/3b339d23b5fe4e0ca51cb0418bf468ec/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.812984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b82c75969416b959d467c38a655d9, user_id=3b339d23b5fe4e0ca51cb0418bf468ec, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.815939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.855227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 990/1998] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:15 2022] PUT /identity/v3/projects/2ecc1b6992da47669c433fd33be02ae6/users/66fc62ea53fa4744adfd924c261dc015/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:15.865748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.866041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.866361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.884147 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1009/1999] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:15 2022] PUT /identity/v3/projects/115b82c75969416b959d467c38a655d9/users/3b339d23b5fe4e0ca51cb0418bf468ec/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:15.888181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.897598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] MFA Rules not processed for user `66fc62ea53fa4744adfd924c261dc015`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:15.899475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:15.954682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362e104-4bda-4731-b10b-065281255a63 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.960552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.964205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.964205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.964205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.964205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.964205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.969810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 991/2000] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:15.976562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.983462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1010/2001] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:15.987437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:15.988710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dba3d-f99e-458d-baae-37e02ced2ca4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:15.993606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:15.994538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:15.994828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:15.995109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:15.995818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:15.997755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:15.997870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552f7c6-9eb7-415f-aa29-c4c1f6a3a6b8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.002825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.003739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.004025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.004320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] PATH_INFO: `/v3/projects/115b82c75969416b959d467c38a655d9/users/3b339d23b5fe4e0ca51cb0418bf468ec/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.006529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b82c75969416b959d467c38a655d9, user_id=3b339d23b5fe4e0ca51cb0418bf468ec, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.009233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0affa7c-05ea-4b87-82d2-52bf83cf820d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.027521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1011/2002] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:15 2022] PUT /identity/v3/projects/115b82c75969416b959d467c38a655d9/users/3b339d23b5fe4e0ca51cb0418bf468ec/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:16.032432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.032714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.033042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.061069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] MFA Rules not processed for user `3b339d23b5fe4e0ca51cb0418bf468ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:16.062384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:16.098345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 992/2003] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:15 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:16.102468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.157777 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1012/2004] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:16.169413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.171070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:16.202824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e26423-48b7-4fa7-96d4-4de9d257df39 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.207683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.209003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.209292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.209572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.210302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.212639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.251584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61fc7-3855-435c-beba-7606fcf74544 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.311317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.311977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.312260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.312685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.330760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 993/2005] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:16 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:16.331810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.351642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf462-0ff0-4a1f-b84c-5c83fb07b12c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.351642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.351642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.351642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.352176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.352176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.352176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.363661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 994/2006] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:16.367618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.380443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:16.381041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2b0e-e0e1-481c-b4b9-b06f32e88585 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.386152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.387205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.391448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.391594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.391700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] PATH_INFO: `/v3/projects/6a91265149a549ca976e9a36def3b0db/users/eee03750ee7b4de8a4ae107f9fd64a9a/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.391790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.400432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1013/2007] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:16.416051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a91265149a549ca976e9a36def3b0db, user_id=eee03750ee7b4de8a4ae107f9fd64a9a, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.419034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.423665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.432622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240b3a-5817-4d00-9024-f50d43a1c4b9 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.436667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.437400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.437759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.438105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.440024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:16.506213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.507686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.512367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 995/2008] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:16 2022] PUT /identity/v3/projects/6a91265149a549ca976e9a36def3b0db/users/eee03750ee7b4de8a4ae107f9fd64a9a/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:16.516554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.525201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1014/2009] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:16.617975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17ad74-7ccc-46de-afbe-c2f756c6a341 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.623953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.624648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.625185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.625474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.626283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.627948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e1dff-df5e-4071-afe9-9b7a6a112abd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.639837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 996/2010] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:16.643936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:16.656055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24eb6-ca77-4238-aeb3-7d8dafc6dbc2 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:16.660720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:16.662239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.662533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.662812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] PATH_INFO: `/v3/projects/6a91265149a549ca976e9a36def3b0db/users/eee03750ee7b4de8a4ae107f9fd64a9a/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.665193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a91265149a549ca976e9a36def3b0db, user_id=eee03750ee7b4de8a4ae107f9fd64a9a, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:16.667923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:16.678702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1015/2011] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:16 2022] PUT /identity/v3/projects/6a91265149a549ca976e9a36def3b0db/users/eee03750ee7b4de8a4ae107f9fd64a9a/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:16.690345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:16.690639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:16.690923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:16.717965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] MFA Rules not processed for user `eee03750ee7b4de8a4ae107f9fd64a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:16.719249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:16.794454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 997/2012] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:17.002841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:17.076412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:17.133591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddbec-3def-42ba-be1f-e24d6fe993dd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:17.137219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:17.137998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:17.138257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:17.138546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:17.149016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:17.150725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:17.165681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1016/2013] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:17.280484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:17.291799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a215a-50b6-4193-acf2-81be60c6c876 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:17.301304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:17.306444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:17.306444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:17.306444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:17.400338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:17.402344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:17.416009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 998/2014] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:17.499805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:18.443093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:18.511293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:19.300403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:19.409490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:20.338517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:20.414839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:21.506158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:22.489324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:22.509656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:22.519563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9c49-bb5a-4658-89b2-424a8499a0fa service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:22.524306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:22.525014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:22.525335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:22.525633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:22.527611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:22.556905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9549aa-ce74-415a-a7a0-4618c969f219 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:22.561523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:22.562466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:22.562788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:22.563043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] PATH_INFO: `/v3/users/fa4f363aebae422c855a97f05d4c3d6a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:22.564262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4f363aebae422c855a97f05d4c3d6a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:22.566368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:22.587525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:22.588972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11f2ba-1c7f-40c0-be85-33b92bb48cdf service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:22.598691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 999/2015] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:22.873710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4f363aebae422c855a97f05d4c3d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:22.874393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4f363aebae422c855a97f05d4c3d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:22.875024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4f363aebae422c855a97f05d4c3d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:22.887257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4f363aebae422c855a97f05d4c3d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:22.968471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:23.014133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4f363aebae422c855a97f05d4c3d6a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:23.028028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1017/2016] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:22 2022] DELETE /identity/v3/users/fa4f363aebae422c855a97f05d4c3d6a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:23.032217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:23.032502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:23.032811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:23.061656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:23.062836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:23.162738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1000/2017] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:23.174019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:23.176961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:23.287984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:23.296422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:23.297316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ff0-3dce-4304-90ac-dfa17a7897f0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:23.306807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:23.307581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:23.307939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:23.308316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:23.318746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:23.320422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:23.332059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1018/2018] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:23.390064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41a004-ac1d-4288-8c48-a92e362db442 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:23.395962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:23.397190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:23.397562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:23.397853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:23.400723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:23.480764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:23.482280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eb7fe-94db-4443-b9cf-fcb340cfb664 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:23.505746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1001/2019] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:23.729823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:23.856909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:23.858574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:23.872856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eae9c-b212-405a-a0a0-c85e4097c1b0 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:23.877997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:23.879172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:23.879936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:23.893974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] PATH_INFO: `/v3/projects/ba55ad93d5aa4e209e180a0de55b61b1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:23.897334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba55ad93d5aa4e209e180a0de55b61b1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:23.903512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:24.052063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba55ad93d5aa4e209e180a0de55b61b1', 'request_id': 'req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.095975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383bf6-bf48-4e67-8559-8969a9328532 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:24.096209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383bf6-bf48-4e67-8559-8969a9328532 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:24.096492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383bf6-bf48-4e67-8559-8969a9328532 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:24.097893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1002/2020] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:32:24.108266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:24.108651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:24.108990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:24.132850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:24.134246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:24.179462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba55ad93d5aa4e209e180a0de55b61b1', 'request_id': 'req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.186928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba55ad93d5aa4e209e180a0de55b61b1', 'request_id': 'req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.199193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] The token cache is being invalidate because project ba55ad93d5aa4e209e180a0de55b61b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:24.199494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.199761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1003/2021] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:32:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:24.200367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.202258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1019/2022] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:23 2022] DELETE /identity/v3/projects/ba55ad93d5aa4e209e180a0de55b61b1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:24.211268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:24.211438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:24.213253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:24.229920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2d5b-94c4-46ee-a8b0-80a39a0f63d5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:24.235747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:24.236415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:24.236737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:24.237048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:24.239608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:24.252261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:24.254034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:24.274600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1020/2023] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:24.292855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24a6aa-e5e8-45e2-a540-2182ed84b5b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:24.292855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:24.292855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:24.292855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:24.293639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] PATH_INFO: `/v3/users/66fc62ea53fa4744adfd924c261dc015` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:24.293639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fc62ea53fa4744adfd924c261dc015)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:24.293639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:24.453362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:24.453362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:24.461389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04a26-c1d7-48d8-9cb7-9ae2d6ba0340 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:24.465958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:24.466858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:24.467143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:24.467422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] PATH_INFO: `/v3/users/704a08e8ad3b4070bcd40b84da161538` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:24.468605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=704a08e8ad3b4070bcd40b84da161538)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:24.470562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:24.610575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fc62ea53fa4744adfd924c261dc015'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.611307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fc62ea53fa4744adfd924c261dc015'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.693850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fc62ea53fa4744adfd924c261dc015'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.711339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fc62ea53fa4744adfd924c261dc015'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.712265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fc62ea53fa4744adfd924c261dc015'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.731424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1004/2024] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:24 2022] DELETE /identity/v3/users/66fc62ea53fa4744adfd924c261dc015 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:24.748501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704a08e8ad3b4070bcd40b84da161538'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.754150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704a08e8ad3b4070bcd40b84da161538'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.755556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704a08e8ad3b4070bcd40b84da161538'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.772813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704a08e8ad3b4070bcd40b84da161538'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.865928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704a08e8ad3b4070bcd40b84da161538'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:24.882072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1021/2025] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:24 2022] DELETE /identity/v3/users/704a08e8ad3b4070bcd40b84da161538 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:25.171064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:25.179764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:25.258841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d3b-f952-42c0-9166-dcd8d48c786f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:25.272772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:25.274365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:25.322554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:25.323944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.324234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.324535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] PATH_INFO: `/v3/projects/0850f366f8c743768011d1c0e0c0e989` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.325769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0850f366f8c743768011d1c0e0c0e989)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:25.327854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:25.357588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20be1c-a5cb-44c6-ba3c-6f7bd053c56d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:25.362352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:25.363312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.363636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.363935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] PATH_INFO: `/v3/projects/2ecc1b6992da47669c433fd33be02ae6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.365138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecc1b6992da47669c433fd33be02ae6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:25.367114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:25.569974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecc1b6992da47669c433fd33be02ae6', 'request_id': 'req-7a9e865f-a23a-4b68-921b-920a723f1331'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.570981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0850f366f8c743768011d1c0e0c0e989', 'request_id': 'req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.653837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecc1b6992da47669c433fd33be02ae6', 'request_id': 'req-7a9e865f-a23a-4b68-921b-920a723f1331'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.660162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecc1b6992da47669c433fd33be02ae6', 'request_id': 'req-7a9e865f-a23a-4b68-921b-920a723f1331'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.671772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] The token cache is being invalidate because project 2ecc1b6992da47669c433fd33be02ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:25.672059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.672705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.674308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1022/2026] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:25 2022] DELETE /identity/v3/projects/2ecc1b6992da47669c433fd33be02ae6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:25.678627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:25.679927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:25.733233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0850f366f8c743768011d1c0e0c0e989', 'request_id': 'req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.741439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0850f366f8c743768011d1c0e0c0e989', 'request_id': 'req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.746776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e865f-a23a-4b68-921b-920a723f1331 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:25.752105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:25.752994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.753290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.753791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] PATH_INFO: `/v3/users/eee03750ee7b4de8a4ae107f9fd64a9a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.754846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee03750ee7b4de8a4ae107f9fd64a9a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:25.755076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] The token cache is being invalidate because project 0850f366f8c743768011d1c0e0c0e989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:25.755407 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.756073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2c71d3c5-aea5-4c10-aa6d-de5ae59a1266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:25.757124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:25.761699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1005/2027] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:25 2022] DELETE /identity/v3/projects/0850f366f8c743768011d1c0e0c0e989 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:25.763231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c371ef-f4bc-403b-bf62-51145dc72920 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.763522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c371ef-f4bc-403b-bf62-51145dc72920 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.763801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c371ef-f4bc-403b-bf62-51145dc72920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.783398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a4c371ef-f4bc-403b-bf62-51145dc72920 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:25.787952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a4c371ef-f4bc-403b-bf62-51145dc72920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:25.794001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1006/2028] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:25.803667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.804062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.804416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.808442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:25.823879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:25.825095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:25.834772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1007/2029] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:25.838951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:25.849440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094c2d3-f6a6-477c-9426-e0aad013cdf7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:25.854228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:25.854895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.855185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.855466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.856196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:25.856506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:25.858115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:25.871851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1008/2030] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:32:25.876327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:25.886824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3411-2a46-4388-9142-8abb5ef24964 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:25.891867 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:25.892524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:25.892816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:25.893099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:25.893785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:25.896301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.022291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:26.029445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1009/2031] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:25 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:26.033534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.038209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee03750ee7b4de8a4ae107f9fd64a9a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:26.038871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee03750ee7b4de8a4ae107f9fd64a9a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:26.039494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee03750ee7b4de8a4ae107f9fd64a9a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:26.052021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee03750ee7b4de8a4ae107f9fd64a9a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:26.099895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932339f-d647-4ec5-b4ba-a36991094d4b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.104683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.108705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.108705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.108705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.108705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.108705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.128642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee03750ee7b4de8a4ae107f9fd64a9a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:26.141134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1023/2032] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:25 2022] DELETE /identity/v3/users/eee03750ee7b4de8a4ae107f9fd64a9a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:26.351094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1010/2033] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:26 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:26.355360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.356788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:26.423385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b732-3ad2-4c25-87c2-df4110bb4a58 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.429600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.431711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.432086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.432447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.433308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.436190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.450889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1024/2034] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:26.454902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.472541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a98b-3d6b-4e25-9cc3-f71326bd5c1a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.478394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.479085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.479378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.479831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.480754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.482730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a257d6c-9650-4b78-a180-c06c659b47c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.493555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1011/2035] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:26.498820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.517305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf504-4c31-4dbb-854f-ec334b0cec86 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.517815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.526852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.527185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.527457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] PATH_INFO: `/v3/projects/59581f23932f44ecba893023f88486d7/users/80053b21eaa04a919d2bf6723018fcfe/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.552245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59581f23932f44ecba893023f88486d7, user_id=80053b21eaa04a919d2bf6723018fcfe, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.555361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.671595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1025/2036] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:26 2022] PUT /identity/v3/projects/59581f23932f44ecba893023f88486d7/users/80053b21eaa04a919d2bf6723018fcfe/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:26.677299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.677588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.677871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.696190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:26.697433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:26.706972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.709322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:26.760341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1012/2037] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:26.771463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:26.772953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:26.790840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7afc34-2f50-457e-b464-394ae4d34a2e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.795825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.796713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.797008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.797293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] PATH_INFO: `/v3/projects/6a91265149a549ca976e9a36def3b0db` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.798779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a91265149a549ca976e9a36def3b0db)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.800671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.834453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c159a-93f5-4109-a0ff-7ab91a98278e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:26.838297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:26.838958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:26.839249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:26.839533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:26.849054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:26.850796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74e49-ae4f-4875-a147-4c14f1dfe882 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:26.861372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1013/2038] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:26.974098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a91265149a549ca976e9a36def3b0db', 'request_id': 'req-2902118b-20c8-45a6-99e2-45562168c3a0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:27.070770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a91265149a549ca976e9a36def3b0db', 'request_id': 'req-2902118b-20c8-45a6-99e2-45562168c3a0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:27.077719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a91265149a549ca976e9a36def3b0db', 'request_id': 'req-2902118b-20c8-45a6-99e2-45562168c3a0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:27.090637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] The token cache is being invalidate because project 6a91265149a549ca976e9a36def3b0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:27.099240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:27.099240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:27.099240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1026/2039] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:26 2022] DELETE /identity/v3/projects/6a91265149a549ca976e9a36def3b0db => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:27.108268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedead9-7cbc-4ff8-85fd-28e8e71d65bd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.108660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedead9-7cbc-4ff8-85fd-28e8e71d65bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.109005 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedead9-7cbc-4ff8-85fd-28e8e71d65bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.173442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1dedead9-7cbc-4ff8-85fd-28e8e71d65bd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:27.174717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1dedead9-7cbc-4ff8-85fd-28e8e71d65bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:27.216832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.218901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:27.239772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1014/2040] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:27.248564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.258469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.258469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.267880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:27.269462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:27.277946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1015/2041] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:27.282550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.288369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902118b-20c8-45a6-99e2-45562168c3a0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.294385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dd093-f85a-4587-b9cc-afb94827ee22 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.297085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.299072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.300034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.300288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.300553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.301964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.302389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.302735 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.303673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:27.303784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:27.304108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.305920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.326245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1016/2042] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:27.327751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.338414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fe59-317a-406b-bcd9-696389f99de9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.344123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.344802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.345093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.345376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.346080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.348610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.376818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.380817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.387966 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1027/2043] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:27.444366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1017/2044] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:27 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:27.448675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.460022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b68c4-2dba-4986-ad5b-2daf4ca0cc9f service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.524546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.525436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.525780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.526068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.526801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.528884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.657381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1028/2045] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:27 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:27.658824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.669999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f04f6-454c-4ffa-841e-3d3f48755323 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.675024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.675802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.676633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.676913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.677684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.679367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.691357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1018/2046] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:27.696633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.710751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece05d8-4dab-4bd5-8872-475d42f4dfe7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.717570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.718544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.718833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.719309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.720135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.721773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2efd-8771-48b2-8bf3-a9629625e0db admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.758067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1029/2047] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:27.758286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.770681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39c20-2071-4466-a069-3e029f612b37 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:27.776102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:27.777078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.777436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.777793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] PATH_INFO: `/v3/projects/746dc716e9954a74a37d90bec60c0d5f/users/d6fc9a39b3ce48949685ff38136a3cb3/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.796811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746dc716e9954a74a37d90bec60c0d5f, user_id=d6fc9a39b3ce48949685ff38136a3cb3, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:27.802163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:27.893747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1019/2048] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:27 2022] PUT /identity/v3/projects/746dc716e9954a74a37d90bec60c0d5f/users/d6fc9a39b3ce48949685ff38136a3cb3/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:27.905245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:27.905536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:27.905818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:27.933994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] MFA Rules not processed for user `d6fc9a39b3ce48949685ff38136a3cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:27.933994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:27.989376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:27.989376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:28.017740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1030/2049] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:28.038576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:28.040439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:28.076329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0209b-f6ef-4252-adfe-9ee4f7ffa7a6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:28.084310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:28.084751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:28.086152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:28.086152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] PATH_INFO: `/v3/users/1267347697f44e329edfe65e9a272eaa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:28.087568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1267347697f44e329edfe65e9a272eaa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:28.089582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:28.130297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cde-6334-4bc1-beee-5b720ab9e859 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:28.134112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:28.134860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:28.135150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:28.135431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:28.144603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:28.146727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414121e0-6e71-494e-a8e0-a7bdfe9358a0 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:28.156107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1031/2050] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:28.297554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1267347697f44e329edfe65e9a272eaa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:28.298623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1267347697f44e329edfe65e9a272eaa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:28.414865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1267347697f44e329edfe65e9a272eaa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:28.423129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1267347697f44e329edfe65e9a272eaa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:28.423827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1267347697f44e329edfe65e9a272eaa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:28.446782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1020/2051] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:27 2022] DELETE /identity/v3/users/1267347697f44e329edfe65e9a272eaa => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:28.448255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:28.448734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:28.449025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:28.474571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:28.476015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:28.550340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1032/2052] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:28.560344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:28.561869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:28.591343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:28.625138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda64-40b0-4bdd-8c8f-e49706088405 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:28.632467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:28.632467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:28.632467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:28.632467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:28.644455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:28.646777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:28.653223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:28.660747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1021/2053] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:29.397766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:29.404709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:29.440261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509cbfa-8ef9-41b1-9c28-279674e9739b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:29.446353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:29.447249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:29.447541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:29.447827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] PATH_INFO: `/v3/projects/b33a22c204d64f7e9edca393cb543a5a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:29.455764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33a22c204d64f7e9edca393cb543a5a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:29.458459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:29.632029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33a22c204d64f7e9edca393cb543a5a', 'request_id': 'req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:29.727619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33a22c204d64f7e9edca393cb543a5a', 'request_id': 'req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:29.734157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33a22c204d64f7e9edca393cb543a5a', 'request_id': 'req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:29.746668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] The token cache is being invalidate because project b33a22c204d64f7e9edca393cb543a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:29.746965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:29.747665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:29.749262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1033/2054] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:29 2022] DELETE /identity/v3/projects/b33a22c204d64f7e9edca393cb543a5a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:29.753520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:29.763467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa77b3-77f1-4b58-bdd4-260d027b0ca3 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:29.833230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:29.834258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:29.834558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:29.834857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] PATH_INFO: `/v3/users/ce1376c0adb24ede8548b212e1b42c40` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:29.836168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1376c0adb24ede8548b212e1b42c40)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:29.840356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:29.893624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:30.029514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1376c0adb24ede8548b212e1b42c40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.030264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1376c0adb24ede8548b212e1b42c40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.133690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1376c0adb24ede8548b212e1b42c40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.145226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1376c0adb24ede8548b212e1b42c40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.146182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6ee5bc04-b980-4fdf-b344-238736c47551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1376c0adb24ede8548b212e1b42c40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.167831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1022/2055] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:29 2022] DELETE /identity/v3/users/ce1376c0adb24ede8548b212e1b42c40 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:30.444767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:30.447131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:30.451853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:30.482057 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca90ea1-18c7-465a-8c12-9002a7f9ff2c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:30.568411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:30.569379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:30.569671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:30.570004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] PATH_INFO: `/v3/users/5e55fa5b9aee40a4a4cd5a402521f5c9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:30.571424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e55fa5b9aee40a4a4cd5a402521f5c9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:30.573654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:30.819209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e55fa5b9aee40a4a4cd5a402521f5c9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.820349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e55fa5b9aee40a4a4cd5a402521f5c9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.821170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e55fa5b9aee40a4a4cd5a402521f5c9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.834968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e55fa5b9aee40a4a4cd5a402521f5c9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.958049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e55fa5b9aee40a4a4cd5a402521f5c9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:30.982827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1034/2056] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:30 2022] DELETE /identity/v3/users/5e55fa5b9aee40a4a4cd5a402521f5c9 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:30.990920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:30.992027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:30.992463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:31.017642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:31.019788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:31.058056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:31.059681 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:31.121059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1023/2057] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:31.131202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:31.133245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:31.181175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b586aab-9b42-49eb-9d81-cdb591e76bd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:31.187993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:31.189538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:31.189838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:31.190123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] PATH_INFO: `/v3/projects/b43d3838744342e29ac444426135b6b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:31.192137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43d3838744342e29ac444426135b6b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:31.195270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:31.356492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe343-33cf-479c-bfa5-612fe6257673 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:31.360725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:31.361715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:31.362162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:31.362617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:31.382530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:31.384110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:31.397101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1024/2058] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:31.443228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43d3838744342e29ac444426135b6b0', 'request_id': 'req-8378f9d9-47be-4abe-8851-dc9f3ad7516f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:31.602466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43d3838744342e29ac444426135b6b0', 'request_id': 'req-8378f9d9-47be-4abe-8851-dc9f3ad7516f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:31.613255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43d3838744342e29ac444426135b6b0', 'request_id': 'req-8378f9d9-47be-4abe-8851-dc9f3ad7516f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:31.632115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] The token cache is being invalidate because project b43d3838744342e29ac444426135b6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:31.633098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:31.634045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:31.637366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1035/2059] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:31 2022] DELETE /identity/v3/projects/b43d3838744342e29ac444426135b6b0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:31.641151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:31.662237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aaa36-671b-411e-ba4a-f6ac76fecb2b service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:31.778625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:31.780418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:31.780418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:31.780418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] PATH_INFO: `/v3/users/03aaa4b4469047a28ae2a699be90195e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:31.781481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03aaa4b4469047a28ae2a699be90195e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:31.783727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:31.915038 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:31.916672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:31.936600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f9d9-47be-4abe-8851-dc9f3ad7516f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:31.947801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:31.948805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:31.949004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:31.949274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] PATH_INFO: `/v3/projects/f3706d89aaac4b0eb255173df5d7a48e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:31.950630 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3706d89aaac4b0eb255173df5d7a48e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:31.953609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:31.999742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03aaa4b4469047a28ae2a699be90195e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.002437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03aaa4b4469047a28ae2a699be90195e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.145716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03aaa4b4469047a28ae2a699be90195e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.160791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03aaa4b4469047a28ae2a699be90195e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.161805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03aaa4b4469047a28ae2a699be90195e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.192899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3706d89aaac4b0eb255173df5d7a48e', 'request_id': 'req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.197667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1025/2060] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:31 2022] DELETE /identity/v3/users/03aaa4b4469047a28ae2a699be90195e => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:32.243197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:32.270801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3706d89aaac4b0eb255173df5d7a48e', 'request_id': 'req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.277617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3706d89aaac4b0eb255173df5d7a48e', 'request_id': 'req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.302118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] The token cache is being invalidate because project f3706d89aaac4b0eb255173df5d7a48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:32.304662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.305804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.308164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1036/2061] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:31 2022] DELETE /identity/v3/projects/f3706d89aaac4b0eb255173df5d7a48e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:32.313497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:32.316928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:32.487475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6955e-81a9-4f01-bd6e-6e771d70595f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:32.509945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:32.509945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:32.509945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:32.509945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] PATH_INFO: `/v3/users/3b339d23b5fe4e0ca51cb0418bf468ec` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:32.511083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b339d23b5fe4e0ca51cb0418bf468ec)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:32.513630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:32.801563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b339d23b5fe4e0ca51cb0418bf468ec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.802244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b339d23b5fe4e0ca51cb0418bf468ec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.904643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b339d23b5fe4e0ca51cb0418bf468ec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.914045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:32.914619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b339d23b5fe4e0ca51cb0418bf468ec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.915122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3f61218-582a-4d37-a787-c94980d5079c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b339d23b5fe4e0ca51cb0418bf468ec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:32.916423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:32.943927 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1026/2062] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:32 2022] DELETE /identity/v3/users/3b339d23b5fe4e0ca51cb0418bf468ec => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:33.044913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f54550-bc9b-42ec-b2d7-cc4c0a1f9b81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:33.122475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:33.123363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:33.123650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:33.123931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] PATH_INFO: `/v3/projects/50c42b00f82343479cb58b2b11cae63e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:33.125172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c42b00f82343479cb58b2b11cae63e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:33.127374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:33.348136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c42b00f82343479cb58b2b11cae63e', 'request_id': 'req-d144500a-a035-43d1-9c4d-6947efa94584'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:33.408901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:33.464918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c42b00f82343479cb58b2b11cae63e', 'request_id': 'req-d144500a-a035-43d1-9c4d-6947efa94584'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:33.472927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c42b00f82343479cb58b2b11cae63e', 'request_id': 'req-d144500a-a035-43d1-9c4d-6947efa94584'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:33.491396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] The token cache is being invalidate because project 50c42b00f82343479cb58b2b11cae63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:33.491702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:33.493345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d144500a-a035-43d1-9c4d-6947efa94584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:33.501550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1037/2063] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:32 2022] DELETE /identity/v3/projects/50c42b00f82343479cb58b2b11cae63e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:33.503523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:33.504924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:33.507479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:33.535872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:33.537151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:33.668104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1027/2064] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:33.679198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:33.679572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:33.679852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:33.711713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:33.713343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:33.729279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1038/2065] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:33.734106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:33.747955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeb44e-8411-41d3-8b11-4ee7fcb853c8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:33.753138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:33.754572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:33.754862 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:33.755157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:33.755917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:33.756283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:33.758330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:33.787721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:33.792537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1028/2066] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:33.801803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e942d-f2ea-4534-a2bf-8b2ad8954ebb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:33.807910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:33.808597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:33.808924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:33.809159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:33.809869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:33.812348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:33.876486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:33.920792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1039/2067] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:33 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:33.921919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:33.941161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3ec-ec5c-4759-a55a-a6345f618c37 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.048923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.058149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.063516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.064110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.064402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.064683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.067369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.070611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59977fc-e0fc-4be9-b410-7d0452e281ea admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.087091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463403f-45f4-489d-ac15-5a73db018ebe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.102356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.104786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.106627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.107229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] PATH_INFO: `/v3/projects/115b82c75969416b959d467c38a655d9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.111161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b82c75969416b959d467c38a655d9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.113714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.161352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1029/2068] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:33 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:34.163059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.163567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.164163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.199612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] MFA Rules not processed for user `80053b21eaa04a919d2bf6723018fcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:34.199702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.277071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1030/2069] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:34.277071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.281046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5193c-3465-4779-9f69-8f62a3b730ec None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.285835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.286615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.286908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.287191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.287925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.289539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b617b-a39d-4fab-ab7a-5ba0707b0bb2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.299696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1031/2070] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:34.301414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.301718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.301998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.328542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] MFA Rules not processed for user `80053b21eaa04a919d2bf6723018fcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:34.329996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.339032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1032/2071] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:34.339944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.353316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea7033-1c98-4301-8e75-04413c37d7b4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.358748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.364084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.364084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.364084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.364084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.364084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.374076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1033/2072] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:34.375064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.378517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.405327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b82c75969416b959d467c38a655d9', 'request_id': 'req-ad17f005-304b-409d-9ecf-09d63f85e062'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:34.462861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e06a8-f3d0-4e49-b834-3873105add80 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.521745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b82c75969416b959d467c38a655d9', 'request_id': 'req-ad17f005-304b-409d-9ecf-09d63f85e062'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:34.528457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b82c75969416b959d467c38a655d9', 'request_id': 'req-ad17f005-304b-409d-9ecf-09d63f85e062'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:34.531923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.536239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.536239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.536239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.540818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] The token cache is being invalidate because project 115b82c75969416b959d467c38a655d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:34.541291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:34.541939 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:34.543561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1040/2073] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:34 2022] DELETE /identity/v3/projects/115b82c75969416b959d467c38a655d9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:34.544453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.545743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.603463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.605279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808425d-39b3-4e51-852d-3cf598cada32 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.616654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f005-304b-409d-9ecf-09d63f85e062 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.617361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1034/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:34.619174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3932-92a0-4b4e-befb-ca7c6e12d99e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.619858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3932-92a0-4b4e-befb-ca7c6e12d99e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.620300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c3932-92a0-4b4e-befb-ca7c6e12d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.625338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.627797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.627797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.627797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] PATH_INFO: `/v3/projects/5ec178643a0349dea826867f76726b4a/users/1b1e74556d9243d4a8eb694c065b1057/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.641577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-850c3932-92a0-4b4e-befb-ca7c6e12d99e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:34.642976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-850c3932-92a0-4b4e-befb-ca7c6e12d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.648621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec178643a0349dea826867f76726b4a, user_id=1b1e74556d9243d4a8eb694c065b1057, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.652683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1035/2075] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:34.656414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24c623-6e89-4c43-8efd-4677bb0b222e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.662093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.662522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.663018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.685399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:34.685399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.696884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1036/2076] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:34.701008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.711738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d604d3-6745-4db6-a9ff-dc1cca8a345b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.717011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.718228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.718228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.718228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.718993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:34.719309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.720922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.733767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1037/2077] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:32:34.738008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.749796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887037-dd5d-4cd0-ad81-be976e74cbf1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.755940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.756614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.756902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.757180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.757876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.759870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.775101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1041/2078] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:34 2022] PUT /identity/v3/projects/5ec178643a0349dea826867f76726b4a/users/1b1e74556d9243d4a8eb694c065b1057/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:34.792575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d0e-0558-4e58-96be-288486060aec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.792871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d0e-0558-4e58-96be-288486060aec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.793157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d0e-0558-4e58-96be-288486060aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.826893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bf161d0e-0558-4e58-96be-288486060aec None None] MFA Rules not processed for user `1b1e74556d9243d4a8eb694c065b1057`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:34.828112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf161d0e-0558-4e58-96be-288486060aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.877705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1038/2079] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:34.882818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.904740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1042/2080] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:34.919106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161d0e-0558-4e58-96be-288486060aec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:34.920722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf161d0e-0558-4e58-96be-288486060aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:34.970419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51169-c1d4-48e6-85cd-ddbac792ae78 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:34.977003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:34.977821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:34.978062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:34.982702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:34.982702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:34.982702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:34.990000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161d0e-0558-4e58-96be-288486060aec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.051670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.052347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.052850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.053145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.085278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1039/2081] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:34 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:35.089506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.126752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd9c96-0330-4748-97e9-6161a4a7f3da admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.133196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.134536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.135229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.135340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.135568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.136013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.136950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.138694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.153576 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1040/2082] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:35.157580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.160890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1043/2083] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:35.170585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46590afb-df8a-4816-a82c-bcee7bb5340e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.180542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.181322 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.182094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.182581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.183107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.184078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.186892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.192406 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:35.195761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b3601-72ea-44b6-bfb6-625f9b7c1bb9 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.200707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1041/2084] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:35.202873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.208791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.208791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.208791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] PATH_INFO: `/v3/users/1b1e74556d9243d4a8eb694c065b1057` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.208998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.209074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1e74556d9243d4a8eb694c065b1057)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.211448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.231745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8c9-cd12-49f6-97dc-53cf7a841355 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.239246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.240507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.242880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.242880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] PATH_INFO: `/v3/projects/0447f4a2e2104013a02f6aa3d93691ec/users/0bbedea940e54ba7b74005956759cf7f/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.259477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0447f4a2e2104013a02f6aa3d93691ec, user_id=0bbedea940e54ba7b74005956759cf7f, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.262506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74f953-5b0f-4214-ac99-ac15a9237e7d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.355433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:35.362136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1042/2085] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:35 2022] PUT /identity/v3/projects/0447f4a2e2104013a02f6aa3d93691ec/users/0bbedea940e54ba7b74005956759cf7f/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:35.380365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a95-f52c-4991-bec5-e37502f5cae0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.380709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a95-f52c-4991-bec5-e37502f5cae0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.380997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a95-f52c-4991-bec5-e37502f5cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.428361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c75f1a95-f52c-4991-bec5-e37502f5cae0 None None] MFA Rules not processed for user `0bbedea940e54ba7b74005956759cf7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:35.438039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c75f1a95-f52c-4991-bec5-e37502f5cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:35.477795 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1e74556d9243d4a8eb694c065b1057'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:35.479875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1e74556d9243d4a8eb694c065b1057'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:35.481325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1e74556d9243d4a8eb694c065b1057'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:35.539174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1e74556d9243d4a8eb694c065b1057'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:35.600347 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1043/2086] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:35.601748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40ab3-2a45-4faa-8fa4-976de110e1d1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.602235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40ab3-2a45-4faa-8fa4-976de110e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.602876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40ab3-2a45-4faa-8fa4-976de110e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.626457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-13e40ab3-2a45-4faa-8fa4-976de110e1d1 None None] MFA Rules not processed for user `80053b21eaa04a919d2bf6723018fcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:35.627116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-13e40ab3-2a45-4faa-8fa4-976de110e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:35.648263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1e74556d9243d4a8eb694c065b1057'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:35.665346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1044/2087] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:35 2022] DELETE /identity/v3/users/1b1e74556d9243d4a8eb694c065b1057 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:35.666711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.671277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:35.703727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1044/2088] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:35.705226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.705590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.705869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.731959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:35.731959 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:35.809696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1045/2089] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:35.824319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef55ae4-fe21-4940-852f-fc8a62739e3c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.824774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.826393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:35.830376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.831793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.832198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.832561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.833341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.835556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.937725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6eccd-8549-480a-93a3-a84f93649b59 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:35.946039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:35.947143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:35.947656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:35.948592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:35.962869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:35.965098 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:35.973631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1045/2090] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:35 2022] POST /identity/v3/projects => generated 373 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:35.982791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:35.985526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1046/2091] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:36.056125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1e3e-390d-49f5-b1fc-dd10e47ac434 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.061746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.062602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.062823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.068287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.068287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.068287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.223258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.223258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:36.227897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab3edc-ec60-4168-86ad-062b924ec73c service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.236784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.237910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.238461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.238931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] PATH_INFO: `/v3/users/d6fc9a39b3ce48949685ff38136a3cb3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.240722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fc9a39b3ce48949685ff38136a3cb3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.244258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.346783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1046/2092] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:35 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:36.350727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.371873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9be4-826a-47ec-bcbb-255471b2cfc6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.377840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.378691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.379593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.384626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.384626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.384626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.406454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1047/2093] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:36.413875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.424375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6d5a4-bc56-4e5e-b4e3-0e8a3699179a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.429838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.430785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.431100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.431380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] PATH_INFO: `/v3/projects/e1d800e2541548adbcf8f728c382aa2a/users/6fbb07de29e54488adbf77c3b192e271/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.468341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d800e2541548adbcf8f728c382aa2a, user_id=6fbb07de29e54488adbf77c3b192e271, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.471841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.559683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fc9a39b3ce48949685ff38136a3cb3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:36.561596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fc9a39b3ce48949685ff38136a3cb3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:36.586477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1048/2094] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:36 2022] PUT /identity/v3/projects/e1d800e2541548adbcf8f728c382aa2a/users/6fbb07de29e54488adbf77c3b192e271/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:36.593574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.598251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:36.641975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fc9a39b3ce48949685ff38136a3cb3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:36.661258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fc9a39b3ce48949685ff38136a3cb3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:36.663069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fc9a39b3ce48949685ff38136a3cb3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:36.713132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1047/2095] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:36 2022] DELETE /identity/v3/users/d6fc9a39b3ce48949685ff38136a3cb3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:36.714832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.718116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:36.775835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0c218-1a98-48dc-af19-c6366af86e81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.841988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef00cd-6868-4c33-9353-025067a693ad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.843424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.844109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.844401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.844684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.845421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.847438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf7dff-fbcb-46e0-b8f1-ae54f4420f1a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.854971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.855910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.856197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.856474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] PATH_INFO: `/v3/projects/5ec178643a0349dea826867f76726b4a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.858118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec178643a0349dea826867f76726b4a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.861432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1049/2096] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:36.862462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.863797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.864105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.864393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.891094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:36.892771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:36.914230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1050/2097] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:36.914997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.934897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092f76-da2a-4a35-96dc-ed731de6acbd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:36.940963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:36.941964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:36.942281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:36.942717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] PATH_INFO: `/v3/projects/e1d800e2541548adbcf8f728c382aa2a/users/6fbb07de29e54488adbf77c3b192e271/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:36.945053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d800e2541548adbcf8f728c382aa2a, user_id=6fbb07de29e54488adbf77c3b192e271, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:36.947782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:36.960421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1051/2098] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:36 2022] PUT /identity/v3/projects/e1d800e2541548adbcf8f728c382aa2a/users/6fbb07de29e54488adbf77c3b192e271/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:36.961595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:36.963317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.045995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7814d77-b3bc-4e83-bea2-4447fd2a179d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.049639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec178643a0349dea826867f76726b4a', 'request_id': 'req-8f008b63-4fd3-40f9-944b-65fafd351908'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:37.057611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:37.117795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec178643a0349dea826867f76726b4a', 'request_id': 'req-8f008b63-4fd3-40f9-944b-65fafd351908'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:37.129471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec178643a0349dea826867f76726b4a', 'request_id': 'req-8f008b63-4fd3-40f9-944b-65fafd351908'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:37.142863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] The token cache is being invalidate because project 5ec178643a0349dea826867f76726b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f008b63-4fd3-40f9-944b-65fafd351908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1048/2099] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:36 2022] DELETE /identity/v3/projects/5ec178643a0349dea826867f76726b4a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.152112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.152594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.152594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.152775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.153127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.155125 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.247109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] MFA Rules not processed for user `6fbb07de29e54488adbf77c3b192e271`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:37.249165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.316318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.318948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbf364-63c4-4b1a-8a15-5f7e02b8919e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.333740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1052/2100] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:37.335277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5b40e-a9a2-4fa2-b089-7715a8a9d78f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.335813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5b40e-a9a2-4fa2-b089-7715a8a9d78f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.336306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5b40e-a9a2-4fa2-b089-7715a8a9d78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.387485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-06a5b40e-a9a2-4fa2-b089-7715a8a9d78f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:37.389256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-06a5b40e-a9a2-4fa2-b089-7715a8a9d78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.391358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1049/2101] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:37.400050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1053/2102] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:37.407621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:37.409199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.414077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.414478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.414802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.445219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:37.450215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.474799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1054/2103] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:37.481094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:37.508290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3054-4580-402e-a5ad-901f0da4efe2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.513516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.515082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.515336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.515686 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.516516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:37.516894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.518636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.524941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f393c-4d85-4456-a0c1-2a2aefffde6b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.528564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.529314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.529683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.530043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.532086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.537749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1055/2104] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:37.542168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:37.557234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e890c5-be6a-4f15-9ef2-ca4db1f93efa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.562720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.563487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.563890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.564293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.565121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.567997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.603272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.605439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.652523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1050/2105] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:37.715166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1056/2106] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:37 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:37.719464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:37.734761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f18c-3919-46e4-9319-cc684fc0bfc3 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.870628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:37.870628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:37.877107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.877964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.878296 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.878666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.879422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.881419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.938629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f33d2-0747-4be6-992d-db7b3ffd5f5e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:37.952683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:37.955794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:37.955794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:37.955794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] PATH_INFO: `/v3/projects/746dc716e9954a74a37d90bec60c0d5f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:37.955794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=746dc716e9954a74a37d90bec60c0d5f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:37.958591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:37.984182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1051/2107] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:37 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:37.986957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.016858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb354d4-b390-45d3-9a67-7f4aec5dbd1a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.027103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.027938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.028352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.029308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.029632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.031504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.046079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1052/2108] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:38.050126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.062616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aa603-ea88-4f30-aecd-7cb55f73873d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.068193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.068962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.069986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.069986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.070789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.072600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.086860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1053/2109] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:38.091448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.104874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c2cf9-1420-4d17-8223-4da8317cd407 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.110570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.111618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.112060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.112469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] PATH_INFO: `/v3/projects/ab562c9919c642e3a51b0ff79f00e8d2/users/1a53f539b29341af828c55955c13e808/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.131228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab562c9919c642e3a51b0ff79f00e8d2, user_id=1a53f539b29341af828c55955c13e808, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.134044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033424ea-3653-4dd8-a7da-4aecc1e943ed admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.149881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746dc716e9954a74a37d90bec60c0d5f', 'request_id': 'req-c4d7533f-6adf-417c-8c16-f006c3305a7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:38.223955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1054/2110] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:38 2022] PUT /identity/v3/projects/ab562c9919c642e3a51b0ff79f00e8d2/users/1a53f539b29341af828c55955c13e808/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:38.236956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.237257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.237542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.273708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] MFA Rules not processed for user `1a53f539b29341af828c55955c13e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:38.274954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:38.282973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746dc716e9954a74a37d90bec60c0d5f', 'request_id': 'req-c4d7533f-6adf-417c-8c16-f006c3305a7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:38.295313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746dc716e9954a74a37d90bec60c0d5f', 'request_id': 'req-c4d7533f-6adf-417c-8c16-f006c3305a7e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:38.309991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] The token cache is being invalidate because project 746dc716e9954a74a37d90bec60c0d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:38.310329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:38.311286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c4d7533f-6adf-417c-8c16-f006c3305a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:38.313925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1057/2111] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:37 2022] DELETE /identity/v3/projects/746dc716e9954a74a37d90bec60c0d5f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:38.324427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:38.331096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2ce-7852-424a-af2b-2705ef76be6e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.331474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2ce-7852-424a-af2b-2705ef76be6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.331999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2ce-7852-424a-af2b-2705ef76be6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.363061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e97d2ce-7852-424a-af2b-2705ef76be6e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:38.365705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e97d2ce-7852-424a-af2b-2705ef76be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:38.429556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1055/2112] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:38.443272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.444859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:38.486351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1058/2113] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:38.496228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.496534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.496858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.525508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:38.533844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:38.546661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1059/2114] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:38.551397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.560299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae19-1e7c-4abe-9be4-1ef81d394f90 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.565043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.565909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.566411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.566877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.571814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb903-8d4a-41c5-b1b0-e5eb0bd3ab3b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.578606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.580330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.583682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.584753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.585047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.585330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.586758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:38.587761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.590160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.602133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1056/2115] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:38.614250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1060/2116] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:32:38.617966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.653159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae911-7278-4c37-9c4e-3f2caaefa4de service glance] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.662880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.681985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.681985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.681985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.681985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.681985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.772291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1057/2117] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:38 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:38.776818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:38.789950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599deaba-e474-4f69-950b-1e60fa50dbd5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:38.876479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:38.877633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:38.878372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:38.878663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:38.879907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:38.882949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:38.944950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:38.998578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1061/2118] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:38 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:39.002719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:39.013892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3afea2-9883-44cf-907a-61c7660bb872 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:39.037001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:39.039545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.039906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.040194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.040967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:39.042693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:39.055189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1058/2119] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:39.059244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:39.072207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed728e-4b82-4823-ac1b-de1a6d5d6ad7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:39.078468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:39.079392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.079749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.080074 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.080847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:39.083064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c812d-148f-4355-bc6e-d80b324acb9e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:39.097262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1062/2120] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:39.098131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:39.108173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdb0e-ddda-4a12-88ab-cf5b602f9ff7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:39.113195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:39.114086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.114451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.114724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] PATH_INFO: `/v3/projects/dfff10dcaecd4017aa61f811df4e6de0/users/7a262f2804434b4fb03a798f54c8e9dd/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.131453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfff10dcaecd4017aa61f811df4e6de0, user_id=7a262f2804434b4fb03a798f54c8e9dd, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:39.134189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:39.296261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1059/2121] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:39 2022] PUT /identity/v3/projects/dfff10dcaecd4017aa61f811df4e6de0/users/7a262f2804434b4fb03a798f54c8e9dd/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:39.317538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.317538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.317538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.346053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] MFA Rules not processed for user `7a262f2804434b4fb03a798f54c8e9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:39.347434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:39.442579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1063/2122] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:39.682211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:39.685780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:39.783175 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89816-ab46-4226-85a6-153a22ea502a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:39.789139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:39.790057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.803456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.803915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.814242 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:39.815770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7865d1-0a0e-41a8-8c5d-3595aaaa93fc service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:39.826637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1060/2123] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:39.868583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:39.969902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02fc5a-54ac-4bd5-9794-2e28718ccb36 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:39.980841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:39.981735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:39.982761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:39.982761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] PATH_INFO: `/v3/users/7a262f2804434b4fb03a798f54c8e9dd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:39.983773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a262f2804434b4fb03a798f54c8e9dd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:39.985853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:40.285992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a262f2804434b4fb03a798f54c8e9dd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:40.286694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a262f2804434b4fb03a798f54c8e9dd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:40.287317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a262f2804434b4fb03a798f54c8e9dd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:40.301557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a262f2804434b4fb03a798f54c8e9dd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:40.381003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a262f2804434b4fb03a798f54c8e9dd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:40.392822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1064/2124] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:39 2022] DELETE /identity/v3/users/7a262f2804434b4fb03a798f54c8e9dd => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:40.398427 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:40.399099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:40.399753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:40.423062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:40.425054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:40.523592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1061/2125] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:40.543454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:40.545452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:40.663290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360261-8943-4d5b-944b-f04b5ee5531f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:40.667160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:40.667897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:40.668187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:40.668470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:40.678271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:40.680073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:40.690881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1065/2126] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:41.056451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:41.316132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:41.318834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:41.334449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16500-9f10-413b-9f8c-4a7126223441 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:41.343736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:41.344776 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.345161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.345699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] PATH_INFO: `/v3/users/0bbedea940e54ba7b74005956759cf7f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.347420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbedea940e54ba7b74005956759cf7f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:41.349759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:41.379518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:41.456194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:41.458388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:41.474975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3cc14-1cc1-4284-a808-23d52c829421 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:41.480742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:41.481743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.482086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.482614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] PATH_INFO: `/v3/projects/dfff10dcaecd4017aa61f811df4e6de0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.483965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfff10dcaecd4017aa61f811df4e6de0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:41.486123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:41.613475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfff10dcaecd4017aa61f811df4e6de0', 'request_id': 'req-ddad21e9-1b63-4344-ad4e-d0a61071bd87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.626781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbedea940e54ba7b74005956759cf7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.627558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbedea940e54ba7b74005956759cf7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.700093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfff10dcaecd4017aa61f811df4e6de0', 'request_id': 'req-ddad21e9-1b63-4344-ad4e-d0a61071bd87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.706990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfff10dcaecd4017aa61f811df4e6de0', 'request_id': 'req-ddad21e9-1b63-4344-ad4e-d0a61071bd87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.720961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] The token cache is being invalidate because project dfff10dcaecd4017aa61f811df4e6de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:41.721964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.723502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddad21e9-1b63-4344-ad4e-d0a61071bd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.727446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1066/2127] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:41 2022] DELETE /identity/v3/projects/dfff10dcaecd4017aa61f811df4e6de0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:41.739332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d92d1-90ca-459c-a045-be759e394a11 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.740178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d92d1-90ca-459c-a045-be759e394a11 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.740731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d92d1-90ca-459c-a045-be759e394a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.764934 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ed1d92d1-90ca-459c-a045-be759e394a11 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:41.766164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ed1d92d1-90ca-459c-a045-be759e394a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:41.826603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1067/2128] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:41.832335 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbedea940e54ba7b74005956759cf7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.836293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.836583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.836869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.841121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbedea940e54ba7b74005956759cf7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.841905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bb92d04-0445-41b6-9869-aa1e6a747d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbedea940e54ba7b74005956759cf7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:41.857634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:41.859129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:41.869937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1068/2129] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:41.877437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:41.890273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba421f9-23aa-40ba-8669-8aaeaa7488b2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:41.890903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1062/2130] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:41 2022] DELETE /identity/v3/users/0bbedea940e54ba7b74005956759cf7f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:41.893560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.895164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.897949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.930413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:41.931667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:41.961634 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:41.962473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:41.962936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:41.963289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:41.964046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:41.964386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:41.966033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:41.981514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1069/2131] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:41.990449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.006604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f12e8-ca6e-45a2-a4c4-2b2998915d37 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.012016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.012902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.013195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.013483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.014189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.015834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1063/2132] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:42.016577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.026498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.028561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:42.090398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb95a-7ade-4c1a-b51e-bd084f2289b2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.094297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.094976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.095293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.095578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.107767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.108237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.120239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1064/2133] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:42.168625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1070/2134] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:42.169636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.182596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979e5f-5fba-43f8-9f6e-5e502da1fc00 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.260395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.261649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.261649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.261923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.263115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.268788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.382383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1065/2135] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:42 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:42.386916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.398117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18e3c-372b-42c9-9075-7dd2d96abc4b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.403991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.404685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.407843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.407843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.407843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.408245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.425620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1071/2136] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:42.425970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.438528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899095d9-753d-4ba0-80db-0d776a5ac793 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.447018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.447945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.448384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.451192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.451192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.453705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea07809-27f2-4798-828e-2b96b814c03a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.469302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1066/2137] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:42.473946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.487334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e042eb-f199-479a-b1e2-6ae20c685573 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.497277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.497277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.497277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.497277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] PATH_INFO: `/v3/projects/75f023fcd8c444e090e7d25e96e91963/users/d2d515a871294f81b122ecbaa4bf5a32/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.522900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f023fcd8c444e090e7d25e96e91963, user_id=d2d515a871294f81b122ecbaa4bf5a32, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.526613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.629249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1072/2138] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:42 2022] PUT /identity/v3/projects/75f023fcd8c444e090e7d25e96e91963/users/d2d515a871294f81b122ecbaa4bf5a32/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:42.635090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.635641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.636147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.659890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:42.662176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:42.772408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1067/2139] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:42.783374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.785999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:42.786216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:42.787381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:42.810936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d5d-96da-4f4f-9077-a41a6e25f119 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.816914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.817844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.818052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.818377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] PATH_INFO: `/v3/projects/0447f4a2e2104013a02f6aa3d93691ec` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.819909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0447f4a2e2104013a02f6aa3d93691ec)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.822306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.867049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372498-a292-4e83-b7bc-772e7f880016 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:42.872698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:42.873380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:42.873814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:42.874152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:42.891387 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:42.892996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:42.916549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1068/2140] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:42.984724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:42.987407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0447f4a2e2104013a02f6aa3d93691ec', 'request_id': 'req-5782a797-dc7e-4b97-93eb-8141880d005e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.077440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0447f4a2e2104013a02f6aa3d93691ec', 'request_id': 'req-5782a797-dc7e-4b97-93eb-8141880d005e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.088666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0447f4a2e2104013a02f6aa3d93691ec', 'request_id': 'req-5782a797-dc7e-4b97-93eb-8141880d005e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.115502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] The token cache is being invalidate because project 0447f4a2e2104013a02f6aa3d93691ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:43.116106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.116524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.118781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1073/2141] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:42 2022] DELETE /identity/v3/projects/0447f4a2e2104013a02f6aa3d93691ec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:43.122944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:43.133267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9ee2-5e7b-4b25-b3a7-93f22f1fe657 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:43.215637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:43.216536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:43.216816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:43.217297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] PATH_INFO: `/v3/users/6fbb07de29e54488adbf77c3b192e271` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:43.218534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbb07de29e54488adbf77c3b192e271)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:43.220483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:43.351305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:43.538609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbb07de29e54488adbf77c3b192e271'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.544278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbb07de29e54488adbf77c3b192e271'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.637599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbb07de29e54488adbf77c3b192e271'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.663193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbb07de29e54488adbf77c3b192e271'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.666406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ac3c9185-8e4c-4d6b-9630-4a85c86b3e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbb07de29e54488adbf77c3b192e271'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:43.696487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1069/2142] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:43 2022] DELETE /identity/v3/users/6fbb07de29e54488adbf77c3b192e271 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:43.939766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:44.426821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:44.428408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:44.444241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a797-dc7e-4b97-93eb-8141880d005e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:44.502547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:44.503419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:44.503760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:44.504087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] PATH_INFO: `/v3/projects/e1d800e2541548adbcf8f728c382aa2a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:44.505298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d800e2541548adbcf8f728c382aa2a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:44.507291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:44.652828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d800e2541548adbcf8f728c382aa2a', 'request_id': 'req-dd272fe5-ffbc-4dca-892f-96239e78946e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:44.744797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d800e2541548adbcf8f728c382aa2a', 'request_id': 'req-dd272fe5-ffbc-4dca-892f-96239e78946e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:44.751334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d800e2541548adbcf8f728c382aa2a', 'request_id': 'req-dd272fe5-ffbc-4dca-892f-96239e78946e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:44.764421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] The token cache is being invalidate because project e1d800e2541548adbcf8f728c382aa2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:44.764726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:44.765401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dd272fe5-ffbc-4dca-892f-96239e78946e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:44.771097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1074/2143] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:44 2022] DELETE /identity/v3/projects/e1d800e2541548adbcf8f728c382aa2a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:44.772574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:44.773059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:44.773141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:44.804043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:44.805592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:44.888265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1070/2144] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:44.897848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:44.898852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:44.899391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:44.923486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:44.924857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:44.933246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1075/2145] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:44.937717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:44.949311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c423db-cb17-4cbe-9255-75d9350b21ab None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:44.956021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:44.958802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:44.958802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:44.958802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:44.959657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:44.960108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:44.962664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:44.980083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1071/2146] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:44.980914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:44.991794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d330a5-f0bc-4004-bdee-500ab13a39a4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:44.997451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:44.997862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:44.998148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:44.998454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:44.999165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.001126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.098840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:45.106256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1076/2147] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:44 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:45.107367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:45.113612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa7f5-c0cf-447e-a3c8-827fc974e279 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:45.182183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:45.182912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.183205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.183487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.184195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.186332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.296124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1072/2148] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:45 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:45.300642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:45.312870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af83d-d9c1-4851-915c-4f8ffa4b2cd5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:45.317821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:45.318493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.318766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.319203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.320066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.321687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.333660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1077/2149] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:45.339078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:45.351376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e049-0b33-40aa-97a4-f5505d5b6107 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:45.356682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:45.357372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.357685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.357973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.359150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.361148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5f34b-c2ab-4865-acc7-8794584238d0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.373515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1073/2150] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:45.378684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:45.389107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7d43-b9a2-45e5-a60c-d9c2bd2f2a1e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:45.393889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:45.395345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.395985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.395985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] PATH_INFO: `/v3/projects/7d383dba6a49471a97c9e19747f4a660/users/87cc4d6f810e491b84fed38c1aca4412/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.413005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d383dba6a49471a97c9e19747f4a660, user_id=87cc4d6f810e491b84fed38c1aca4412, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.415835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.511307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1078/2151] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:45 2022] PUT /identity/v3/projects/7d383dba6a49471a97c9e19747f4a660/users/87cc4d6f810e491b84fed38c1aca4412/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:45.523516 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb69ac-8e62-4fc0-b093-32532219931a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.523804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb69ac-8e62-4fc0-b093-32532219931a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.524088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb69ac-8e62-4fc0-b093-32532219931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.561740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fbcb69ac-8e62-4fc0-b093-32532219931a None None] MFA Rules not processed for user `87cc4d6f810e491b84fed38c1aca4412`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:45.563657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fbcb69ac-8e62-4fc0-b093-32532219931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:45.658370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1074/2152] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:45.671255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:45.680386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:45.765477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5858bea-00ab-422d-84be-f8a5a371b510 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:45.769890 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:45.770589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:45.770878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:45.771186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:45.780640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:45.782243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:45.793082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1079/2153] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:46.432641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:46.574117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:49.008502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:49.723094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:49.723413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:49.723701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:49.767419 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] MFA Rules not processed for user `d2d515a871294f81b122ecbaa4bf5a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:49.768717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:49.864183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1075/2154] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:49.870413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:49.872703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:49.976144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b2ae-b191-410a-b3ff-f0b30b83a4d3 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:49.981160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:49.981835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:49.982121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:49.982478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:49.983181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:49.988642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.109163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1080/2155] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:49 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:50.112891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:50.127353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf400-c943-40fe-8824-babf6fd15941 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:50.192660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:50.245687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:50.247400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:50.247400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:50.247400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:50.248229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:50.255556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.404264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1076/2156] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:50 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:32:50.406070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:50.436698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef0e6-ba8a-41c3-b7d9-2c44630db771 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:50.452816 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:50.454490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:50.454881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:50.456068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:50.457238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:50.463557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.475152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1081/2157] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:50.479473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:50.493358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:50.505742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801b5b-c370-4244-87fd-daa78e7218ee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:50.511634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:50.512544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:50.512836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:50.513119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] PATH_INFO: `/v3/projects/fe655d4efb144bf3af2efa058d595494/users/865382b3794c4598b871b55581963c79/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:50.534638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe655d4efb144bf3af2efa058d595494, user_id=865382b3794c4598b871b55581963c79, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:50.538369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.692632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1077/2158] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:50 2022] PUT /identity/v3/projects/fe655d4efb144bf3af2efa058d595494/users/865382b3794c4598b871b55581963c79/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:50.696687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:50.707752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67add1-304e-4908-94b9-f6e54b07aa67 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:50.820172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:50.830779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:50.830779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:50.830779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:50.830779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:50.830779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.839047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1082/2159] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:50.840411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:50.852280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9edd-3ee6-4fd7-bb50-1f159eeb3eab admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:50.865648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:50.866612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:50.866896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:50.867172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] PATH_INFO: `/v3/projects/fe655d4efb144bf3af2efa058d595494/users/865382b3794c4598b871b55581963c79/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:50.871389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe655d4efb144bf3af2efa058d595494, user_id=865382b3794c4598b871b55581963c79, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:50.879792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5537747-1c20-44f5-b7ca-a9f8d763bbd8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:50.900193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1078/2160] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:50 2022] PUT /identity/v3/projects/fe655d4efb144bf3af2efa058d595494/users/865382b3794c4598b871b55581963c79/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:32:51.999374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:52.015072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92d7b-09e0-4597-80f1-034eb1d37df8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:52.125115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:52.126409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:52.127129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:52.127615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] PATH_INFO: `/v3/users/87cc4d6f810e491b84fed38c1aca4412` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:52.130677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cc4d6f810e491b84fed38c1aca4412)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:52.132734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:52.477858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cc4d6f810e491b84fed38c1aca4412'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:52.478881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cc4d6f810e491b84fed38c1aca4412'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:52.479730 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cc4d6f810e491b84fed38c1aca4412'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:52.495358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cc4d6f810e491b84fed38c1aca4412'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:52.591273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cc4d6f810e491b84fed38c1aca4412'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:52.608530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1083/2161] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:51 2022] DELETE /identity/v3/users/87cc4d6f810e491b84fed38c1aca4412 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:52.613052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:52.613561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:52.613654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:52.636244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:52.637972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:52.725720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1079/2162] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:52.737138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:52.739881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:52.822218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c003d7-25b6-4a7e-89a8-ea9204c02bb0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:52.826054 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:52.826940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:52.827312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:52.827750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:52.838814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:52.840310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b31a0-8c40-441f-a4bf-bc1494161133 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:52.862528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1084/2163] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:32:53.701456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:53.704137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:53.758769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655112fe-e2cb-4709-aa28-c01c99b065c2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:53.776341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:53.777236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:53.777528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:53.779453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] PATH_INFO: `/v3/projects/7d383dba6a49471a97c9e19747f4a660` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:53.783795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d383dba6a49471a97c9e19747f4a660)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:53.791402 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:53.953494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d383dba6a49471a97c9e19747f4a660', 'request_id': 'req-11876210-2367-40f4-97eb-5aec8f66963f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:54.077038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d383dba6a49471a97c9e19747f4a660', 'request_id': 'req-11876210-2367-40f4-97eb-5aec8f66963f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:54.086620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d383dba6a49471a97c9e19747f4a660', 'request_id': 'req-11876210-2367-40f4-97eb-5aec8f66963f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:54.107062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] The token cache is being invalidate because project 7d383dba6a49471a97c9e19747f4a660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:54.107404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:54.110463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11876210-2367-40f4-97eb-5aec8f66963f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:54.118546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1080/2164] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:53 2022] DELETE /identity/v3/projects/7d383dba6a49471a97c9e19747f4a660 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:54.123988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:54.124554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:54.124554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:54.163228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:54.164925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:54.320724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1085/2165] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:32:54.329697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:54.329991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:54.331463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:54.390947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:54.393675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:54.418486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1081/2166] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:54.433273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:54.479130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525af7-8365-45d3-9348-499c68a88b36 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:54.495213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:54.496006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:54.496424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:54.496823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:54.502855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:32:54.503448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:54.505674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:54.546044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1086/2167] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:32:54.547215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:54.562691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406bb30-cfa7-4f8a-96b0-4ed4b0f4083c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:54.596870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:54.599713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:54.600202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:54.600677 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:54.601703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:54.605668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:54.665692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:54.751225 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1082/2168] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:54.751646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:54.765222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc009-01c0-413f-9b86-33be106fdb02 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:54.866601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:54.867692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:54.867825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:54.868028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:54.868314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:54.869030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:54.871570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:54.961642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1087/2169] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:32:54 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:32:54.963882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:54.985383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041038-ad2c-4851-8572-630e07131f80 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:54.995341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:55.003920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:55.004248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:55.004541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:55.005431 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:55.007687 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:55.026270 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1083/2170] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:32:55.027452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:55.051960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113403a-4f71-41af-b5d0-5b52b4b51aa2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:55.068958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:55.069848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:55.070226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:55.070753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:55.071656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:55.073395 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5992e-dd2d-4909-8b15-3eda6c35f8bc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:55.095336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:55.103436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1088/2171] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:32:55.111471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b240-63cc-492f-bcab-e873992489e7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:55.117957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:55.119191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:55.119656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:55.120463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] PATH_INFO: `/v3/projects/38a70cde2f54464ab0e97b1218489870/users/35ea430cfcbc4236af2be83ffcde77fb/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:55.152425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a70cde2f54464ab0e97b1218489870, user_id=35ea430cfcbc4236af2be83ffcde77fb, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:55.158054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:55.314177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1084/2172] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:32:55 2022] PUT /identity/v3/projects/38a70cde2f54464ab0e97b1218489870/users/35ea430cfcbc4236af2be83ffcde77fb/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:55.325589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74578f4-1b5d-433b-8bf8-68b3894299d4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:55.325589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74578f4-1b5d-433b-8bf8-68b3894299d4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:55.325589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74578f4-1b5d-433b-8bf8-68b3894299d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:55.355265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c74578f4-1b5d-433b-8bf8-68b3894299d4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:55.356531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c74578f4-1b5d-433b-8bf8-68b3894299d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:55.506546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1089/2173] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:55.518506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:55.521996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:55.636812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3773cf6-241b-4894-9504-e31330e567e7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:55.649259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:55.649259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:55.649728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:55.650760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:55.667130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:55.669311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7d96-f332-4849-b75e-24f2a899d444 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:55.688922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1085/2174] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:56.517437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:56.518004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:56.518306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:56.519865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1090/2175] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:32:56.543520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:56.544064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:56.544064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:56.574791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] MFA Rules not processed for user `7edebd2d5e7048639b43be8ae5288a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:32:56.576983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:56.729579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1086/2176] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:32:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:32:56.752928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:56.760886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:56.830618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a32a6-67aa-4b03-b3ca-202da0862156 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:56.837554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:56.839332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:56.840151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:56.840637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:56.857661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:56.861915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:56.872949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1091/2177] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:32:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:32:57.728915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:57.821355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:58.253567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:58.256379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:58.274871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2552-c7e8-4804-bc86-45cdab883ea5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:58.282009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:58.283788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:58.284078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:58.284354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] PATH_INFO: `/v3/users/df86a233e3324897a3ca9fcd73679820` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:58.286455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df86a233e3324897a3ca9fcd73679820)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:58.288465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:58.561625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df86a233e3324897a3ca9fcd73679820'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:58.562533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df86a233e3324897a3ca9fcd73679820'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:58.679416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df86a233e3324897a3ca9fcd73679820'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:58.690072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df86a233e3324897a3ca9fcd73679820'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:58.691134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df86a233e3324897a3ca9fcd73679820'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:58.712059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1087/2178] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:58 2022] DELETE /identity/v3/users/df86a233e3324897a3ca9fcd73679820 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:58.992199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:59.003744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ff43-e088-4348-bdcc-7c566eab1b83 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:59.075856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:59.076973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:59.077868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:59.078373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] PATH_INFO: `/v3/projects/ef14e79517fc4337a3740a7ee322a015` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:59.080153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef14e79517fc4337a3740a7ee322a015)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:59.083299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:59.250380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef14e79517fc4337a3740a7ee322a015', 'request_id': 'req-7e58853e-344a-4590-bf8b-8e3edd8e3d52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.511095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef14e79517fc4337a3740a7ee322a015', 'request_id': 'req-7e58853e-344a-4590-bf8b-8e3edd8e3d52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.518949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef14e79517fc4337a3740a7ee322a015', 'request_id': 'req-7e58853e-344a-4590-bf8b-8e3edd8e3d52'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.562263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] The token cache is being invalidate because project ef14e79517fc4337a3740a7ee322a015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:32:59.562573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.563319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.568651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1092/2179] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:32:58 2022] DELETE /identity/v3/projects/ef14e79517fc4337a3740a7ee322a015 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:32:59.572812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:59.574905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:32:59.592460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3faa-139e-4d2d-8082-6b6b8e4bf079 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:32:59.654610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:59.698027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:32:59.699206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:32:59.702121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:32:59.703232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] PATH_INFO: `/v3/users/ca75741ac2ab4071be45b0c778f4c173` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:32:59.709085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca75741ac2ab4071be45b0c778f4c173)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:32:59.711663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:32:59.972438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca75741ac2ab4071be45b0c778f4c173'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.973698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca75741ac2ab4071be45b0c778f4c173'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:32:59.988524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:32:59.988524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:00.000847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58853e-344a-4590-bf8b-8e3edd8e3d52 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:00.009137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:00.010335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:00.011663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:00.021211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] PATH_INFO: `/v3/users/1a53f539b29341af828c55955c13e808` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:00.023823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a53f539b29341af828c55955c13e808)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:00.027095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:00.059237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca75741ac2ab4071be45b0c778f4c173'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.070611 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca75741ac2ab4071be45b0c778f4c173'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.071661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33c8dc6-516f-498e-8b5b-e8a5f4ba6fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca75741ac2ab4071be45b0c778f4c173'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.103736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1088/2180] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:59 2022] DELETE /identity/v3/users/ca75741ac2ab4071be45b0c778f4c173 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:00.240375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a53f539b29341af828c55955c13e808'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.241437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a53f539b29341af828c55955c13e808'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.242131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a53f539b29341af828c55955c13e808'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.273655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a53f539b29341af828c55955c13e808'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.362918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a53f539b29341af828c55955c13e808'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:00.437224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1093/2181] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:32:59 2022] DELETE /identity/v3/users/1a53f539b29341af828c55955c13e808 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:00.443618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:00.444120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:00.445601 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:00.481449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:00.482985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:00.518615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:00.520154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:00.527626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:00.688594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1089/2182] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:00.733363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba781f1-c3aa-4799-afeb-f4644c6f35ae admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:00.742728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:00.743913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:00.744303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:00.744692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] PATH_INFO: `/v3/projects/eb4a2c038d73479f9238fdb796821634` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:00.747806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4a2c038d73479f9238fdb796821634)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:00.763232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:00.765146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:00.786333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:00.908848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56c91-e271-4f0a-8eb2-cb34ba77cbe4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:00.921899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:00.922616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:00.923898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:00.923898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:00.951015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:00.952517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ad3e9-d3b7-4f4d-9544-b87e850848b9 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:00.965276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1090/2183] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:01.027700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4a2c038d73479f9238fdb796821634', 'request_id': 'req-a044f920-42fa-4e28-b769-b23a85f58c3b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:01.128089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4a2c038d73479f9238fdb796821634', 'request_id': 'req-a044f920-42fa-4e28-b769-b23a85f58c3b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:01.136340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4a2c038d73479f9238fdb796821634', 'request_id': 'req-a044f920-42fa-4e28-b769-b23a85f58c3b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:01.180876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] The token cache is being invalidate because project eb4a2c038d73479f9238fdb796821634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:01.181175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:01.181926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a044f920-42fa-4e28-b769-b23a85f58c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:01.193079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1094/2184] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:00 2022] DELETE /identity/v3/projects/eb4a2c038d73479f9238fdb796821634 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:01.193283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.193745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.194125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.228202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:01.229653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:01.329604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.330045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.330467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.333248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1091/2185] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:01.353279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:01.354734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:01.365294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1095/2186] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:01.370567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.383354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b903b-5a52-40c6-b2d0-cd118536a81d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.389582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.390448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.390970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.391348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.392203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:33:01.392615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.395674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.415451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1092/2187] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:33:01.418224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.432226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d60ca8-4761-40c1-81bf-081ef72b6c0e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.437920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.438688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.438978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.439268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.439994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.442440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.560222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1096/2188] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:01 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:01.564413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.575793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6349ad-f83d-4667-88b4-d7c503fdd840 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.644004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.645680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.645977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.646304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.647819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.650432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.716951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1093/2189] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:01 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:33:01.728233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.739508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f422-72e2-4b44-916b-741fb330ab72 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.745805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.746731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.747051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.747329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.748068 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.749854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.763055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1097/2190] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:01.768872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.781162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99004-16ca-4f4c-89b4-fa9e0c175057 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.786324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.787044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.787330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.787613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.788355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.789999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.805985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1094/2191] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:01.811313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.824066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea594ca-306d-47e0-9b9f-4ae20113d908 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:01.828412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:01.829474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.829765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.830049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] PATH_INFO: `/v3/projects/6751444007be44deb83505e6770944fe/users/d170cb27a3a8482d8f20c879261e4ad8/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.852283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6751444007be44deb83505e6770944fe, user_id=d170cb27a3a8482d8f20c879261e4ad8, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:01.855365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae0aa0-8b32-412c-82cc-7b1efcd50e69 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:01.942027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:01.947957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:01.958149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1098/2192] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:01 2022] PUT /identity/v3/projects/6751444007be44deb83505e6770944fe/users/d170cb27a3a8482d8f20c879261e4ad8/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:01.961659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:01.961955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:01.964449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:01.994336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27b8c5-3741-4987-8da3-3d903ae9c39e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:02.041519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] MFA Rules not processed for user `d170cb27a3a8482d8f20c879261e4ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:02.049382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:02.122562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:02.150038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:02.151143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.151671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.151671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] PATH_INFO: `/v3/projects/ab562c9919c642e3a51b0ff79f00e8d2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.153928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab562c9919c642e3a51b0ff79f00e8d2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:02.156384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:02.201231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1099/2193] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:02.218532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:02.220369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:02.231627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:02.301913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71b5bd-6fd8-4e3e-bdf6-3d04448d72ec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:02.306513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:02.307378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.307612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.307917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.323762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:02.325236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d95d-5ad3-4a48-914f-bdcec3e8c2f2 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:02.339404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1100/2194] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:02.340907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0e9f-3c96-42a3-848f-06290875ba4b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.341211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0e9f-3c96-42a3-848f-06290875ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.341498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0e9f-3c96-42a3-848f-06290875ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.375491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-057a0e9f-3c96-42a3-848f-06290875ba4b None None] MFA Rules not processed for user `252b0cfb5934429ba31adc44ee4a556e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:02.379150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab562c9919c642e3a51b0ff79f00e8d2', 'request_id': 'req-338b5386-4f4e-43e1-9737-5f259a1b9756'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:02.379324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-057a0e9f-3c96-42a3-848f-06290875ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:02.471705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab562c9919c642e3a51b0ff79f00e8d2', 'request_id': 'req-338b5386-4f4e-43e1-9737-5f259a1b9756'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:02.474142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1101/2195] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:02.481430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab562c9919c642e3a51b0ff79f00e8d2', 'request_id': 'req-338b5386-4f4e-43e1-9737-5f259a1b9756'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:02.503220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] The token cache is being invalidate because project ab562c9919c642e3a51b0ff79f00e8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:02.506662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:02.508075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-338b5386-4f4e-43e1-9737-5f259a1b9756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:02.516000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1095/2196] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:01 2022] DELETE /identity/v3/projects/ab562c9919c642e3a51b0ff79f00e8d2 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:02.518776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.522226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.522226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.565560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:02.568993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:02.669173 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1102/2197] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:02.670729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.671011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.671435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.694422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:02.695676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:02.704498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1096/2198] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:02.708974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:02.721691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038477a-9de1-475e-ba46-9db0988470fe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:02.727266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:02.728000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.728294 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.728883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.729638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:33:02.729948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:02.732097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:02.746474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1103/2199] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:33:02.753170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:02.764624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfb48-d5f4-4e49-b348-801d606e8801 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:02.774129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:02.782579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.782579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.782579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.782579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:02.782579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:02.880179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1097/2200] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:02 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:33:02.884988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:02.898922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab407f-793a-4e3e-9114-5331cc2c11e1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:02.989737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:02.990612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:02.990912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:02.991196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:02.991904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:02.993859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.145609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1104/2201] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:02 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:03.147442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.185515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff1ea4-f5bd-41fe-8042-b12457463e41 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:03.193841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:03.193841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.193841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.193841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.197022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:03.197022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.211978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1098/2202] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:03.217779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.240369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b4a7-e8b4-41df-8a38-7a8823047bc6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:03.246958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:03.247770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.248163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.248584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.251468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:03.254350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db701a9-bf67-4c75-84ca-ef442f252c19 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.270257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1105/2203] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:03.271707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.294751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963df0-1799-4b4f-a77d-cc0a85e91d3b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:03.323220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:03.323220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.323220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.323220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] PATH_INFO: `/v3/projects/527756423c454a07b28f5b768185a82e/users/ec2e846198d84e23814afa0a3b5a1f16/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.349135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527756423c454a07b28f5b768185a82e, user_id=ec2e846198d84e23814afa0a3b5a1f16, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:03.355900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b8860-727b-459c-a728-b7566de2e954 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.494795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1099/2204] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:03 2022] PUT /identity/v3/projects/527756423c454a07b28f5b768185a82e/users/ec2e846198d84e23814afa0a3b5a1f16/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:03.498515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.499010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.499295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.517394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.518609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.518963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.565240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] MFA Rules not processed for user `865382b3794c4598b871b55581963c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:03.576155 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:03.579763 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] MFA Rules not processed for user `ec2e846198d84e23814afa0a3b5a1f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:03.580994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:03.713603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1106/2205] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:03.719025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1100/2206] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:03.726012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.726121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.726237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:03.807638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7b6e-6686-47ec-b2af-1d1d952827dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:03.816902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:03.822685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.822685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.822685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.822685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:03.845845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770d5e-eb47-4d94-9d87-d1bc6a20fe8d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:03.852297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:03.853097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:03.853394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:03.853666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:03.854524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:03.856556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.968693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:03.974104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1107/2207] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:03 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:03.974797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:03.976157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:03.984642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1101/2208] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:04.099913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8928d-f2d5-4ee7-bade-d925b41a1786 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.114687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.115479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.115822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.116107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.116819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.118978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:04.244295 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1108/2209] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:03 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:04.247964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:04.261430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd9fbf-5e14-47cc-afc0-17286ab3c4d8 service glance] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.279063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.279978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.280095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.280314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.281058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.282864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d81e7-7bc4-4f25-a5f7-f955eff07932 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:04.310484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1102/2210] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:04.311476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:04.319223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5108c2-99f7-4f6c-8ec5-1556046b3744 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.319908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5108c2-99f7-4f6c-8ec5-1556046b3744 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.320471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5108c2-99f7-4f6c-8ec5-1556046b3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.324961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd2186-4755-45e3-99e7-61041ff3382c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.332828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.334965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.335261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.335550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.336362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.338115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:04.354188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1109/2211] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:33:04.358334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:04.362211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7c5108c2-99f7-4f6c-8ec5-1556046b3744 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:04.363771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7c5108c2-99f7-4f6c-8ec5-1556046b3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:04.374287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02d182-7b57-45a6-a411-29b83af26328 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.381241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.382739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.382880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.383368 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] PATH_INFO: `/v3/projects/64f41ceb2baa4d31894e0ee64ca1f50f/users/8b711ebed8a44337a1073da33d2e6427/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.420172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f41ceb2baa4d31894e0ee64ca1f50f, user_id=8b711ebed8a44337a1073da33d2e6427, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.429322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49aa3d0-8b2e-4c57-98ad-c1b7c7c36a5b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:04.487684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1103/2212] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:04.500166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.500652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.501094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.514687 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1110/2213] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:04 2022] PUT /identity/v3/projects/64f41ceb2baa4d31894e0ee64ca1f50f/users/8b711ebed8a44337a1073da33d2e6427/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:04.525561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.527494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.527838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.545002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] MFA Rules not processed for user `d170cb27a3a8482d8f20c879261e4ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:04.547251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:04.586844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:04.620736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] MFA Rules not processed for user `8b711ebed8a44337a1073da33d2e6427`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:04.625555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:04.625789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:04.652231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1104/2214] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:04.655139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:04.660164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:04.767695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414947cb-53dd-4772-bc25-5164f5fc58e7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.774706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.776198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.776717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.777252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.790642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1111/2215] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:04.796139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:04.880856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.882519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:04.894749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1105/2216] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:33:04.951558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a38ad-e9da-4f36-8c01-fcf5b8962b7f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:04.959482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:04.960504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:04.960764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:04.961045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:04.961818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:04.966862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:05.103453 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:05.110644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1112/2217] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:04 2022] POST /identity/v3/projects => generated 383 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:05.124822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d625-3e5f-426f-909e-355aff1fa82a service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:05.340462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:05.342588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:05.345631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:05.347835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:05.348755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:05.356338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:05.479554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1106/2218] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:05 2022] POST /identity/v3/users => generated 298 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:05.480891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:05.508436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8b6e-ac2f-4334-ac65-7c82f1b5db0c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:05.511676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:05.524369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:05.525075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:05.525367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:05.525647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:05.531018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:05.532738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:05.591924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1113/2219] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:05.593963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:05.605684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c1ee-cd66-43a3-8dfa-73135fd9ead5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:05.610574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:05.611466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:05.611911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:05.612199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] PATH_INFO: `/v3/projects/1c1ae121dee24c458c9956c30adfe727/users/68bb40d3d042443a88233e988bb04748/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:05.633198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1ae121dee24c458c9956c30adfe727, user_id=68bb40d3d042443a88233e988bb04748, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:05.637515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:05.756136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1107/2220] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:05 2022] PUT /identity/v3/projects/1c1ae121dee24c458c9956c30adfe727/users/68bb40d3d042443a88233e988bb04748/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:05.760281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:05.780451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24378-3252-46ca-bdec-60d64b2fd5f1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:05.900479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:05.901142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:05.901430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:05.901758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:05.902573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:05.924920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fae81-d4c9-49c5-83ec-ac069793c6ab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:05.968317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1114/2221] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:05.971957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:05.985240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:05.996737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f2989-8095-4d4c-8dd6-d85d8dbf7fa6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:06.026027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:06.027263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:06.027849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:06.028933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] PATH_INFO: `/v3/projects/1c1ae121dee24c458c9956c30adfe727/users/68bb40d3d042443a88233e988bb04748/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:06.033678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1ae121dee24c458c9956c30adfe727, user_id=68bb40d3d042443a88233e988bb04748, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:06.048757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:06.097602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1108/2222] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:05 2022] PUT /identity/v3/projects/1c1ae121dee24c458c9956c30adfe727/users/68bb40d3d042443a88233e988bb04748/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:06.099695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b695f7-df7d-4bec-b3e5-362a745f5a46 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:06.099985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b695f7-df7d-4bec-b3e5-362a745f5a46 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:06.100337 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b695f7-df7d-4bec-b3e5-362a745f5a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:06.219107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9b695f7-df7d-4bec-b3e5-362a745f5a46 None None] MFA Rules not processed for user `68bb40d3d042443a88233e988bb04748`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:06.220371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9b695f7-df7d-4bec-b3e5-362a745f5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:06.495420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1115/2223] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:06.510079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:06.511131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:06.764569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0edc-41fd-46b2-9624-2d79573bab16 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:06.785344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:06.785344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:06.785344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:06.785344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:07.061036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:07.068528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:07.173182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1109/2224] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:07.192717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:08.047736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:09.110654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070227ea-92bc-41de-b324-3f0957b6adcf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:09.110654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070227ea-92bc-41de-b324-3f0957b6adcf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:09.110654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070227ea-92bc-41de-b324-3f0957b6adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:09.160469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-070227ea-92bc-41de-b324-3f0957b6adcf None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:09.165385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-070227ea-92bc-41de-b324-3f0957b6adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:09.265368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:09.341869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1116/2225] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:09.369020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:09.467275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:09.467483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:09.467757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:09.521641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] MFA Rules not processed for user `35ea430cfcbc4236af2be83ffcde77fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:09.525487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:09.555406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a707c3-a4ca-433e-a805-344621a946b6 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:09.569036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:09.569714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:09.569995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:09.570413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:09.591857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:09.606716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:09.636509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1110/2226] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:33:09.715428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1117/2227] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:09.720159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:09.722819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:09.952318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bbcc3-cbb7-4565-abc1-e30c9c68099e service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:09.971395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:09.972099 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:09.972388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:09.972664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:09.973368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:09.979754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:10.036945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:10.167170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1111/2228] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:09 2022] POST /identity/v3/projects => generated 373 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:10.170999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:10.188261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56bd3-b989-4b7c-af11-5879b0f67121 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:10.219262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:10.222050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:10.452238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629bac-fdf9-45ce-9f6f-d3b9416f83e9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:10.489221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:10.490894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:10.495650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:10.497950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:10.505992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:10.510932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:10.510932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:10.510932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:10.510932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:10.517493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:10.631694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:10.702392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1118/2229] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:10 2022] POST /identity/v3/users => generated 293 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:10.711285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:10.726829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:10.728766 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:10.737282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcb9a-edac-41ed-b968-edd7b0ae654d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:10.763427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:10.763427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:10.763427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:10.763427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:10.763739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:10.763820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1112/2230] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:10.770010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:10.799983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1119/2231] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:10.809065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:10.834574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae81fa-5ed9-43f0-a543-5ddc0eddf088 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:10.841780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:10.843048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:10.843866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:10.844350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] PATH_INFO: `/v3/projects/83a61633df19496e9ed36e91fe0b1f66/users/c36a3854e97344a095a7ca7bc189821e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:10.868970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a61633df19496e9ed36e91fe0b1f66, user_id=c36a3854e97344a095a7ca7bc189821e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:10.879899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:11.050807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1113/2232] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:10 2022] PUT /identity/v3/projects/83a61633df19496e9ed36e91fe0b1f66/users/c36a3854e97344a095a7ca7bc189821e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:11.057070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:11.072275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f2fd-3d27-4e73-98af-0bfec2457db1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:11.303206 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:11.304605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:11.305087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:11.305371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:11.306622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:11.308598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:11.325508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:11.328758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1120/2233] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:33:11.368216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebba65-e3e4-4a82-9196-0c555c9b12b8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:11.397539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:11.400185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:11.400506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:11.400792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] PATH_INFO: `/v3/projects/83a61633df19496e9ed36e91fe0b1f66/users/c36a3854e97344a095a7ca7bc189821e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:11.417599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a61633df19496e9ed36e91fe0b1f66, user_id=c36a3854e97344a095a7ca7bc189821e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:11.437680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:11.497610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1114/2234] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:11 2022] PUT /identity/v3/projects/83a61633df19496e9ed36e91fe0b1f66/users/c36a3854e97344a095a7ca7bc189821e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:11.724546 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:12.689024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:13.361928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:13.632899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34977d3-913d-4e62-92de-7d8ba663c507 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:13.779801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:13.781252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:13.781696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:13.782129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:13.965013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:13.970932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149798b-2a57-4895-807b-46165eece59d service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:13.999203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1121/2235] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:14.151288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:14.197422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:15.625537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:16.190332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:17.192833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:17.476642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:20.060354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:20.311619 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:20.545442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:20.958068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167541-67fd-46e8-89e6-2f52fb4389d4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:20.970674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:20.971581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:20.971866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:20.975353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] PATH_INFO: `/v3/users/ec2e846198d84e23814afa0a3b5a1f16` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:20.978126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2e846198d84e23814afa0a3b5a1f16)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:20.981130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:21.392474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2e846198d84e23814afa0a3b5a1f16'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:21.393412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2e846198d84e23814afa0a3b5a1f16'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:21.499704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2e846198d84e23814afa0a3b5a1f16'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:21.514291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2e846198d84e23814afa0a3b5a1f16'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:21.515121 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2e846198d84e23814afa0a3b5a1f16'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:21.573681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1115/2236] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:33:20 2022] DELETE /identity/v3/users/ec2e846198d84e23814afa0a3b5a1f16 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:21.591763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:21.592929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:21.593360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:21.828486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:21.830225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:22.042314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1122/2237] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:22.085706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:22.092795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:22.438263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d122-d039-40bc-8d3d-508d08e559c2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:22.449037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:22.451290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:22.451734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:22.457556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:22.477695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:22.479538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:22.524871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1116/2238] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:22.737172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:22.762963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:23.497805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:23.608576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:24.331606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:24.333758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:24.384156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2853-710b-4a07-8423-f9ef2896fe6e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:24.410424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:24.411209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:24.411488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:24.411770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] PATH_INFO: `/v3/projects/527756423c454a07b28f5b768185a82e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:24.414784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527756423c454a07b28f5b768185a82e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:24.416762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:24.494208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:24.580203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527756423c454a07b28f5b768185a82e', 'request_id': 'req-69571ec9-f5ab-45ad-85b1-33d8b94d9624'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:24.631659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:24.704756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527756423c454a07b28f5b768185a82e', 'request_id': 'req-69571ec9-f5ab-45ad-85b1-33d8b94d9624'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:24.711824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527756423c454a07b28f5b768185a82e', 'request_id': 'req-69571ec9-f5ab-45ad-85b1-33d8b94d9624'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:24.734972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] The token cache is being invalidate because project 527756423c454a07b28f5b768185a82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:24.735268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:24.735928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:24.750843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1123/2239] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:24 2022] DELETE /identity/v3/projects/527756423c454a07b28f5b768185a82e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:24.757040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:24.765948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37550-1d8a-4eba-b0bd-5fc9370b2a51 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:25.032250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:25.033394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:25.033761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:25.034118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] PATH_INFO: `/v3/users/8b711ebed8a44337a1073da33d2e6427` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:25.077083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b711ebed8a44337a1073da33d2e6427)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:25.077083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:26.006124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b711ebed8a44337a1073da33d2e6427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:26.017987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b711ebed8a44337a1073da33d2e6427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:26.110823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b711ebed8a44337a1073da33d2e6427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:26.132885 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b711ebed8a44337a1073da33d2e6427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:26.134179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b711ebed8a44337a1073da33d2e6427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:26.164401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1117/2240] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:33:24 2022] DELETE /identity/v3/users/8b711ebed8a44337a1073da33d2e6427 => generated 0 bytes in 1413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:26.497480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:26.672847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:27.112497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:27.707266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:27.709782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:27.733204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:27.756216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571ec9-f5ab-45ad-85b1-33d8b94d9624 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:27.910749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:27.912838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:27.913278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:27.913461 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] PATH_INFO: `/v3/projects/64f41ceb2baa4d31894e0ee64ca1f50f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:27.914911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f41ceb2baa4d31894e0ee64ca1f50f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:27.917384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:28.455383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f41ceb2baa4d31894e0ee64ca1f50f', 'request_id': 'req-6fbaff7f-bc05-45f6-96ea-09edc4abad54'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:28.574489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f41ceb2baa4d31894e0ee64ca1f50f', 'request_id': 'req-6fbaff7f-bc05-45f6-96ea-09edc4abad54'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:28.586346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f41ceb2baa4d31894e0ee64ca1f50f', 'request_id': 'req-6fbaff7f-bc05-45f6-96ea-09edc4abad54'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:28.629330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] The token cache is being invalidate because project 64f41ceb2baa4d31894e0ee64ca1f50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:28.630353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:28.631053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6fbaff7f-bc05-45f6-96ea-09edc4abad54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:28.637711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:28.639620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:28.644683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1124/2241] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:27 2022] DELETE /identity/v3/projects/64f41ceb2baa4d31894e0ee64ca1f50f => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:28.655928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c81ea5-dad5-4fbd-85e8-3c77c93568a3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:28.749110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:28.750728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:28.751263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:28.751764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] PATH_INFO: `/v3/users/68bb40d3d042443a88233e988bb04748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:28.754701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bb40d3d042443a88233e988bb04748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:28.758320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:28.934669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:29.055686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bb40d3d042443a88233e988bb04748'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:29.056549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bb40d3d042443a88233e988bb04748'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:29.215700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bb40d3d042443a88233e988bb04748'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:29.229170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bb40d3d042443a88233e988bb04748'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:29.229170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bb40d3d042443a88233e988bb04748'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:29.312730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1118/2242] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:33:28 2022] DELETE /identity/v3/users/68bb40d3d042443a88233e988bb04748 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:29.323534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:29.794573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24cb8-aa23-41c0-be96-04759afeabb3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:29.794913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24cb8-aa23-41c0-be96-04759afeabb3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:29.795320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24cb8-aa23-41c0-be96-04759afeabb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:29.858665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9cc24cb8-aa23-41c0-be96-04759afeabb3 None None] MFA Rules not processed for user `c36a3854e97344a095a7ca7bc189821e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:29.860561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9cc24cb8-aa23-41c0-be96-04759afeabb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:29.934564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:29.968358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:30.021648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1125/2243] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:30.051218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:30.052850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:30.228528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dcadf-c90f-414c-8fd5-10c6b5ebd4c7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:30.242818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:30.244377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:30.245140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:30.245637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:30.250772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:30.387328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:30.389333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:30.424112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1119/2244] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:30.523671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961ea8-dbb2-44d1-a9c8-b706edbb5573 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:30.523671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961ea8-dbb2-44d1-a9c8-b706edbb5573 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:30.524317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961ea8-dbb2-44d1-a9c8-b706edbb5573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:30.552526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:30.554384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3b961ea8-dbb2-44d1-a9c8-b706edbb5573 None None] MFA Rules not processed for user `d2d515a871294f81b122ecbaa4bf5a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:30.555667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b961ea8-dbb2-44d1-a9c8-b706edbb5573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:30.621849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:30.738950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1126/2245] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:30.855557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:31.901284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:31.902970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:31.994887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a6b6f-968b-4087-91ae-06b9f36b979b service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:32.010118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:32.010905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:32.011379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:32.011657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] PATH_INFO: `/v3/projects/1c1ae121dee24c458c9956c30adfe727` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:32.013552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1ae121dee24c458c9956c30adfe727)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:32.015866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:32.213989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1ae121dee24c458c9956c30adfe727', 'request_id': 'req-ecda588c-1976-4dcf-a4eb-5004561cf7ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:32.305218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1ae121dee24c458c9956c30adfe727', 'request_id': 'req-ecda588c-1976-4dcf-a4eb-5004561cf7ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:32.314693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1ae121dee24c458c9956c30adfe727', 'request_id': 'req-ecda588c-1976-4dcf-a4eb-5004561cf7ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:32.372534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] The token cache is being invalidate because project 1c1ae121dee24c458c9956c30adfe727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:32.374275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:32.383101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ecda588c-1976-4dcf-a4eb-5004561cf7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:32.395497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1120/2246] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:31 2022] DELETE /identity/v3/projects/1c1ae121dee24c458c9956c30adfe727 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:32.396163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:32.396642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:32.396738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:32.563473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:32.565229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:32.717342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:32.751833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1127/2247] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:32.813279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:32.813596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:32.813884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:32.842920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:32.843263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:32.882435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:32.893466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccca7e-c75c-4435-8589-a971bcd75884 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:32.897190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1121/2248] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:32.908623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:32.909707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:32.909987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:32.910300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:32.912151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:33:32.913540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:32.916022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:32.936101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:32.949387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1128/2249] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:33:32.950938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d15c6-42d0-44e7-8037-7652c4a51b7c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:32.957061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:32.957993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:32.958482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:32.959305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:32.960328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:32.962575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:32.985801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:33.062376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1122/2250] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:33:33.064311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:33.084161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538fdc-a406-4e15-9dd7-f602089179fc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:33.227083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:33.228234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:33.229047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:33.229478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:33.234217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:33.246577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:33.516907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:33.523077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1129/2251] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:33:33 2022] POST /identity/v3/users => generated 287 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:33:33.551632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8951bf-dfe1-4c84-99b7-12e323488b40 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:33.569381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:33.571491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:33.573530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:33.574142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:33.576746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:33.582903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:33.646677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:33.657294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1123/2252] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:33.669639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0239f1-8cb2-4a12-a75d-d597de86df0f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:33.684006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:33.687566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:33.687865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:33.688156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:33.688984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:33.690881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf0a2-f2b2-40bd-8b7a-e7e7cefe8806 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:33.714312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1130/2253] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:33:33.718234 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:33.754330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5835ba-8735-4d9f-87d7-ffa24620d571 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:33.789383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:33.792461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:33.792754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:33.793034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] PATH_INFO: `/v3/projects/7018426cde0d419bb1e5bed3274ccd81/users/db141a96ab9e4bd4bcfa421918cc4fd0/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:33.847542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7018426cde0d419bb1e5bed3274ccd81, user_id=db141a96ab9e4bd4bcfa421918cc4fd0, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:33.850156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:33.929217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1124/2254] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:33:33 2022] PUT /identity/v3/projects/7018426cde0d419bb1e5bed3274ccd81/users/db141a96ab9e4bd4bcfa421918cc4fd0/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:33.940047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3223-2099-4fe1-b695-baf5949ebb07 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:33.940679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3223-2099-4fe1-b695-baf5949ebb07 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:33.941112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3223-2099-4fe1-b695-baf5949ebb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:34.025725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eb2e3223-2099-4fe1-b695-baf5949ebb07 None None] MFA Rules not processed for user `db141a96ab9e4bd4bcfa421918cc4fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:34.028112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eb2e3223-2099-4fe1-b695-baf5949ebb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:34.188003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1131/2255] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:34.204378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:34.210983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:34.399833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9851-ae61-40b7-8c73-28c9b14fdf2e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:34.413679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:34.414405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:34.415177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:34.415323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:34.439428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:34.441603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a8193-4f69-4ad2-9193-71384f6ffc43 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:34.475155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1125/2256] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:34.665557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:34.791597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:35.819841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:36.296174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:36.296818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:36.296818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:36.317198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] MFA Rules not processed for user `35ea430cfcbc4236af2be83ffcde77fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:36.318454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:36.399265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1132/2257] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:36.751925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:37.437198 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:38.181052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:38.991770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:39.083658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:39.107373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d3f-9db8-4336-b302-9f4283fb20e3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:39.107667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d3f-9db8-4336-b302-9f4283fb20e3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:39.108118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d3f-9db8-4336-b302-9f4283fb20e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:39.167740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-79060d3f-9db8-4336-b302-9f4283fb20e3 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:39.169003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-79060d3f-9db8-4336-b302-9f4283fb20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:39.265074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1126/2258] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:39.286509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:39.286509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:39.389617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4b3e-cfda-4c8a-af61-f3e89ae83f0d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:39.396547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:39.397701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:39.398142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:39.398741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:39.429833 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:39.431169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b90267-b96c-42ca-83c8-93f3a342b5d8 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:39.461950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1133/2259] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:33:41.541880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:42.019266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:43.383357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648cc7-1e78-4e54-9c71-9f2b711906a1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:43.384494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648cc7-1e78-4e54-9c71-9f2b711906a1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:43.385011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648cc7-1e78-4e54-9c71-9f2b711906a1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:43.387416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1127/2260] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:33:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:33:43.421331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215018-4acc-4526-a567-74f9229e691d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:43.421331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215018-4acc-4526-a567-74f9229e691d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:43.421331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215018-4acc-4526-a567-74f9229e691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:43.531786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-48215018-4acc-4526-a567-74f9229e691d None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:43.533409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-48215018-4acc-4526-a567-74f9229e691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:43.664522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1134/2261] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:43.934925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:44.237131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:45.585902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:45.966362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:48.420818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648cc7-1e78-4e54-9c71-9f2b711906a1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:48.549785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648cc7-1e78-4e54-9c71-9f2b711906a1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:48.558254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:48.558254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:48.558254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:48.562909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] PATH_INFO: `/v3/users/db141a96ab9e4bd4bcfa421918cc4fd0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:48.568709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db141a96ab9e4bd4bcfa421918cc4fd0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:48.568709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:48.762010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db141a96ab9e4bd4bcfa421918cc4fd0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:48.762736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db141a96ab9e4bd4bcfa421918cc4fd0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:48.825714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db141a96ab9e4bd4bcfa421918cc4fd0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:48.836033 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db141a96ab9e4bd4bcfa421918cc4fd0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:48.836874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db141a96ab9e4bd4bcfa421918cc4fd0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:48.863442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1128/2262] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:33:48 2022] DELETE /identity/v3/users/db141a96ab9e4bd4bcfa421918cc4fd0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:48.865341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:48.865850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:48.866090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:48.897420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:48.898969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:48.916113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:48.980957 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1135/2263] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:48.991232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:48.992759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.055401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736909-452a-45d5-be1b-8a4294f0588a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:49.059045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:49.059702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.060078 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.060367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.074568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:49.076032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:49.086968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1129/2264] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:49.337113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:49.337113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.434709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae8dd-8967-47c9-aabc-6947f1598e72 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:49.439066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:49.439941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.440849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.441225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.443232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.531107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:49.532580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b25ba9-a9b5-4ffb-a060-ec2b0c076247 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:49.549976 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1136/2265] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:49.576307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:49.577580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.593779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d58058-8af4-493e-b61e-d681269c7d48 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:49.611381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:49.612800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.613089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.613444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] PATH_INFO: `/v3/projects/7018426cde0d419bb1e5bed3274ccd81` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.614680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7018426cde0d419bb1e5bed3274ccd81)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:49.616722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:49.635673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:49.727752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7018426cde0d419bb1e5bed3274ccd81', 'request_id': 'req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:49.735966 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27ce1b-afde-4cd3-acaa-6f70a9f33a0e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.736301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27ce1b-afde-4cd3-acaa-6f70a9f33a0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.736592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27ce1b-afde-4cd3-acaa-6f70a9f33a0e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.738170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1137/2266] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:33:49.743248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91cb9-ac71-4994-9398-9fa88aade0d6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.743540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91cb9-ac71-4994-9398-9fa88aade0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.743901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e91cb9-ac71-4994-9398-9fa88aade0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.766528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-13e91cb9-ac71-4994-9398-9fa88aade0d6 None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:49.768084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13e91cb9-ac71-4994-9398-9fa88aade0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.775403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7018426cde0d419bb1e5bed3274ccd81', 'request_id': 'req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:49.786403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7018426cde0d419bb1e5bed3274ccd81', 'request_id': 'req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:49.802336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] The token cache is being invalidate because project 7018426cde0d419bb1e5bed3274ccd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:33:49.804594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:49.804594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:33:49.806019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1130/2267] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:33:49 2022] DELETE /identity/v3/projects/7018426cde0d419bb1e5bed3274ccd81 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:33:49.858390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1138/2268] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:49.866795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:49.868434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:49.883861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10396-d15d-4ee7-a6f9-bc2f79aa0e1a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:49.898364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:49.899161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:49.899459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:49.899743 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:49.908470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:49.910658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301f879-9658-4439-9c59-c72052c8ba0c service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:49.920519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1131/2269] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:50.036909 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:50.042387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:50.042387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:50.042387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1139/2270] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:33:50.045224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c5ab-2d78-4e69-89b9-3c65535ff972 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:50.045713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c5ab-2d78-4e69-89b9-3c65535ff972 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:50.046160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c5ab-2d78-4e69-89b9-3c65535ff972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:50.067040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5302c5ab-2d78-4e69-89b9-3c65535ff972 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:50.068266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5302c5ab-2d78-4e69-89b9-3c65535ff972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:50.145595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1132/2271] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:33:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:50.150034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:50.152004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:50.166671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252306-fb96-4387-8c61-bbcfd5ea3456 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:50.170511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:50.171226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:50.171591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:50.171938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:50.184190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:33:50.186500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:50.187983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:50.199019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1140/2272] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:33:55.538340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454c5c-af3f-4aa3-8999-5ac75fd14a5b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:55.538835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454c5c-af3f-4aa3-8999-5ac75fd14a5b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:55.538915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454c5c-af3f-4aa3-8999-5ac75fd14a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:55.557634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f9454c5c-af3f-4aa3-8999-5ac75fd14a5b None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:55.558939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9454c5c-af3f-4aa3-8999-5ac75fd14a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:55.631136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1133/2273] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:55.644132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:55.645703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:55.726753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3d85-e5f1-4717-a4b0-8ec8feecc31b service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:55.732583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:55.733515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:55.733977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:55.734495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:55.744697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:55.746383 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:55.766463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1141/2274] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:33:56.374065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760a3fb-1e0d-4499-aaa4-a5cbfe929f46 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:56.374579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760a3fb-1e0d-4499-aaa4-a5cbfe929f46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:56.374880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760a3fb-1e0d-4499-aaa4-a5cbfe929f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:56.395368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b760a3fb-1e0d-4499-aaa4-a5cbfe929f46 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:56.396930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b760a3fb-1e0d-4499-aaa4-a5cbfe929f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:56.405000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1134/2275] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:56.417750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:56.430657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f13b-af2d-426d-b851-5d4497c25b9f service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:56.436228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:56.436885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:56.437176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:56.437462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:56.447167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:56.448812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:56.457892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1142/2276] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:33:56.683606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b048fd-d1cb-4daa-a541-8abb69f64113 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:56.684561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b048fd-d1cb-4daa-a541-8abb69f64113 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:56.684561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b048fd-d1cb-4daa-a541-8abb69f64113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:56.704215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d1b048fd-d1cb-4daa-a541-8abb69f64113 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:56.705438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d1b048fd-d1cb-4daa-a541-8abb69f64113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:56.713381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1135/2277] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:33:56.736065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:56.762849 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d34ce-f0d2-4e74-a4fa-9ccb5babfb85 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:56.795965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:56.796799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:56.797093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:56.797378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:56.820467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:56.820825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:56.845631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1143/2278] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:33:58.511737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f6ad-89c6-4390-8cb4-df3502b65cc6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:58.512275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f6ad-89c6-4390-8cb4-df3502b65cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:58.512275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f6ad-89c6-4390-8cb4-df3502b65cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:58.530662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e584f6ad-89c6-4390-8cb4-df3502b65cc6 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:58.531864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e584f6ad-89c6-4390-8cb4-df3502b65cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:58.539902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1136/2279] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:58.567554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:58.579673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd9983-9be1-4655-b1e2-627fe61ac0a9 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:58.592923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:58.592923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:58.592923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:58.592923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:58.596077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:58.597706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:58.607033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1144/2280] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:33:59.631471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:59.631992 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:59.632072 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:59.651947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:33:59.653146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:33:59.660717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1137/2281] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:33:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:33:59.673347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:33:59.684280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b66d-7404-49fb-8094-0a80e76ca228 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:33:59.689277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:33:59.689920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:33:59.690225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:33:59.690509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:33:59.705253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:33:59.707375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0476042-69f9-41e3-8d01-2d8dbcb6691b service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:33:59.718751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1145/2282] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:34:02.501321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:02.503501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:02.510563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:02.592552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90d6ae-3965-4f6c-aeb7-24a9f1c99897 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:02.598071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:02.599130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:02.599470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:02.599750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] PATH_INFO: `/v3/users/d170cb27a3a8482d8f20c879261e4ad8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:02.601043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d170cb27a3a8482d8f20c879261e4ad8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:02.603259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:03.584295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd170cb27a3a8482d8f20c879261e4ad8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:03.584295 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd170cb27a3a8482d8f20c879261e4ad8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:03.722831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd170cb27a3a8482d8f20c879261e4ad8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:03.731757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd170cb27a3a8482d8f20c879261e4ad8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:03.732506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd170cb27a3a8482d8f20c879261e4ad8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:03.751913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1138/2283] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:34:02 2022] DELETE /identity/v3/users/d170cb27a3a8482d8f20c879261e4ad8 => generated 0 bytes in 1251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:34:03.756516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:03.757055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:03.757162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:03.775174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:03.776388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:03.849409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1146/2284] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:03.859778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:03.861856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:03.924676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842600-b947-4fbd-8888-47d556348d22 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:03.928813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:03.929204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:03.929556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:03.929843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:03.939843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:03.941378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027faac3-d142-479b-b992-dc5155d9ba33 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:03.951791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1139/2285] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:04.268933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:04.268933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:04.299205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c9c06-2a82-4c41-80db-9087e1583d4d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:04.299205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:04.299906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:04.299906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:04.300307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] PATH_INFO: `/v3/projects/6751444007be44deb83505e6770944fe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:04.301318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6751444007be44deb83505e6770944fe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:04.303857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:04.414254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:04.439072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6751444007be44deb83505e6770944fe', 'request_id': 'req-147c8fc8-d902-402e-8964-89f4c30f1a24'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:04.511122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6751444007be44deb83505e6770944fe', 'request_id': 'req-147c8fc8-d902-402e-8964-89f4c30f1a24'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:04.517475 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6751444007be44deb83505e6770944fe', 'request_id': 'req-147c8fc8-d902-402e-8964-89f4c30f1a24'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:04.529474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] The token cache is being invalidate because project 6751444007be44deb83505e6770944fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:34:04.529767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:04.530452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-147c8fc8-d902-402e-8964-89f4c30f1a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:04.531999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1147/2286] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:34:04 2022] DELETE /identity/v3/projects/6751444007be44deb83505e6770944fe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:34:04.537507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:04.537800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:04.538076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:04.558952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:04.560171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:04.581946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:04.637567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1140/2287] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:34:04.681330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:04.681646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:04.682002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:04.705330 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:04.706819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:04.720946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1148/2288] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:04.722135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:04.738410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c0046-95f6-4e10-a13d-a7bdec34c195 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:04.748231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:04.748923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:04.749215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:04.749508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:04.750290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:34:04.750613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:04.755054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:04.793736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1141/2289] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:34:04.799108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:04.828647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c855bb9-2378-4993-afca-eab97c099bf9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:04.834594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:04.835691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:04.836227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:04.836771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:04.837866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:04.840688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:05.042997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1149/2290] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:34:04 2022] POST /identity/v3/projects => generated 389 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:34:05.050761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:05.061904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c32b67-8f39-4637-b095-239ad2c2560b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:05.126874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:05.127680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:05.128040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:05.128390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:05.129215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:05.131472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:05.243105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1142/2291] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:34:05 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:34:05.247624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:05.258913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985812c6-bb66-48d4-b3d2-dea43bcc0219 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:05.263744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:05.264463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:05.264786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:05.265071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:05.265817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:05.267486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:05.279708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1150/2292] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:34:05.284498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:05.295304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e162-ee63-4eb0-9c70-32fde54498d0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:05.300230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:05.303934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:05.303934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:05.303934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:05.303934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:05.303934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffa941-c5b7-4f80-9a2e-1156a4dddd05 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:05.316254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1143/2293] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:34:05.321699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:05.342165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384f4b-718f-470d-ad0c-cf3e8b5c3953 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:05.346924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:05.347823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:05.348112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:05.348386 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] PATH_INFO: `/v3/projects/1811d89bf4a346a3be09ba6303433911/users/d905e626045a4d37a5cc23738c1cf0cf/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:05.365870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1811d89bf4a346a3be09ba6303433911, user_id=d905e626045a4d37a5cc23738c1cf0cf, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:05.368615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:05.741832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1151/2294] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:34:05 2022] PUT /identity/v3/projects/1811d89bf4a346a3be09ba6303433911/users/d905e626045a4d37a5cc23738c1cf0cf/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:34:05.758281 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:05.758837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:05.758837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:05.788731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] MFA Rules not processed for user `d905e626045a4d37a5cc23738c1cf0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:05.790947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:05.897861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1144/2295] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:05.909632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:05.911618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:06.015288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33bcf-f2d8-4cbd-9b1f-3ed4c69f5e91 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:06.019592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:06.021539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:06.021539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:06.021539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:06.039567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:06.041357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4f8ee-c89d-4671-9601-8b31fe328c01 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:06.057115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1152/2296] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:11.830310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:11.831742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:11.856483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:11.945890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a47c1-f3fc-4efa-8b22-6fc44affab20 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:11.958547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:11.961609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:11.961609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:11.961609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:11.963711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:11.996378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:12.000195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:12.015145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1145/2297] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:16.049846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=76,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:16.637678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:16.638282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:16.638723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:16.701702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:16.703089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:16.784534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1153/2298] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:34:16.806493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:16.808021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:16.905961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce9c02-a2fd-407e-a933-a0b042d5dc36 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:16.911178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:16.911840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:16.912127 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:16.912409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:16.921330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:16.922968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ef65-4725-4cd5-9b2e-b05294af5f14 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:16.932011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1146/2299] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:34:18.454029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:18.521518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06d248-9012-47b0-8fef-eb870dc80e1c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:18.526035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:18.526960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:18.527253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:18.527536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] PATH_INFO: `/v3/users/d905e626045a4d37a5cc23738c1cf0cf` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:18.528785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d905e626045a4d37a5cc23738c1cf0cf)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:18.530766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:18.878402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd905e626045a4d37a5cc23738c1cf0cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:18.879261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd905e626045a4d37a5cc23738c1cf0cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:18.879886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd905e626045a4d37a5cc23738c1cf0cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:18.895637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd905e626045a4d37a5cc23738c1cf0cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:18.968604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd905e626045a4d37a5cc23738c1cf0cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:18.971221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:18.984644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1154/2300] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:34:18 2022] DELETE /identity/v3/users/d905e626045a4d37a5cc23738c1cf0cf => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:34:18.989410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:18.989886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:18.990012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:19.011421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:19.012997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:19.079131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:19.088541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1147/2301] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:19.103438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:19.104854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:19.163009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069bcad-89f1-435e-8f3b-ccc527b0829f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:19.166661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:19.167323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:19.167608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:19.167883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:19.177110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:19.178596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:19.188551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1155/2302] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:19.741572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:19.743480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:19.758086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152b51-f69f-4a68-b206-54b2573c9434 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:19.762996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:19.763872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:19.764163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:19.764447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] PATH_INFO: `/v3/projects/1811d89bf4a346a3be09ba6303433911` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:19.765682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1811d89bf4a346a3be09ba6303433911)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:19.767778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:19.865588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1811d89bf4a346a3be09ba6303433911', 'request_id': 'req-d70977dd-dad6-4022-a69f-f47da87991fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:19.910736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1811d89bf4a346a3be09ba6303433911', 'request_id': 'req-d70977dd-dad6-4022-a69f-f47da87991fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:19.917120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1811d89bf4a346a3be09ba6303433911', 'request_id': 'req-d70977dd-dad6-4022-a69f-f47da87991fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:19.927705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] The token cache is being invalidate because project 1811d89bf4a346a3be09ba6303433911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:34:19.927996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:19.929117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:34:19.930854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1148/2303] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:34:19 2022] DELETE /identity/v3/projects/1811d89bf4a346a3be09ba6303433911 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:34:22.710801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:22.712964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:22.728235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9583-8892-4ca6-8acb-a9168d9bbe07 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:22.834558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:22.835738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:22.836030 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:22.836310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:22.839665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:22.928730 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:22.930324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e93303-2709-4ca0-9bdc-4b4136bd15b0 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:22.940975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1156/2304] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:24.358378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:34:24.359857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:24.373302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977dd-dad6-4022-a69f-f47da87991fc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:34:24.377087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:34:24.377679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:24.377973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:24.378302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:24.380137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:24.450026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:34:24.451640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31142-65e5-4ea3-95b1-85253d971edb service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:34:24.467215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1149/2305] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:34:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:34:32.936659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=80 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:34.458872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:38.106757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2849cc-389c-4910-b89a-d8396248b1b2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:38.108464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2849cc-389c-4910-b89a-d8396248b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:38.108464 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2849cc-389c-4910-b89a-d8396248b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:38.125820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4e2849cc-389c-4910-b89a-d8396248b1b2 None None] MFA Rules not processed for user `80053b21eaa04a919d2bf6723018fcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:38.127090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e2849cc-389c-4910-b89a-d8396248b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:38.186458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1157/2306] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:40.663021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2c78-9758-4818-b508-ac2df5aaa80e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:34:40.663596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2c78-9758-4818-b508-ac2df5aaa80e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:34:40.663596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2c78-9758-4818-b508-ac2df5aaa80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:34:40.681063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-448c2c78-9758-4818-b508-ac2df5aaa80e None None] MFA Rules not processed for user `252b0cfb5934429ba31adc44ee4a556e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:34:40.682414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-448c2c78-9758-4818-b508-ac2df5aaa80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:34:40.739838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1150/2307] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:34:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:34:48.178828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:50.732659 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:35:22.587209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1e7e-cccc-478d-a35b-6901a14dbc42 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:35:22.590551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1e7e-cccc-478d-a35b-6901a14dbc42 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:35:22.590551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e1e7e-cccc-478d-a35b-6901a14dbc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:35:22.607992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-de2e1e7e-cccc-478d-a35b-6901a14dbc42 None None] MFA Rules not processed for user `fdc5beed67fc45f588145a525a12e1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:35:22.609221 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-de2e1e7e-cccc-478d-a35b-6901a14dbc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:35:22.672434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1158/2308] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:35:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:35:24.855749 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671ca3-3ab7-4950-b8f9-ac3cf8017cad None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:35:24.857439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671ca3-3ab7-4950-b8f9-ac3cf8017cad None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:35:24.857439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671ca3-3ab7-4950-b8f9-ac3cf8017cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:35:24.874985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c6671ca3-3ab7-4950-b8f9-ac3cf8017cad None None] MFA Rules not processed for user `c0457bc532ce47aeabdec2643f53b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:35:24.876310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6671ca3-3ab7-4950-b8f9-ac3cf8017cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:35:24.931800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1151/2309] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:35:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:35:32.664701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:35:34.924617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:35:57.167679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:35:57.168357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:35:57.168357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:35:57.189266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] MFA Rules not processed for user `252b0cfb5934429ba31adc44ee4a556e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:35:57.193124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:35:57.197793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1159/2310] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:35:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:07.183236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:07.726845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:07.727379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:07.727489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:07.745444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] MFA Rules not processed for user `80053b21eaa04a919d2bf6723018fcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:07.746689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:07.754950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1152/2311] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:36:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:10.754720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:10.756202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:10.772196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715be28-cd42-47fd-995e-2e70088bbb73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:10.781031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:10.785183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:10.785579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:10.785961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:10.789516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:10.888015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:10.889558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd2cd3-d52a-45e0-8c05-959be8230da6 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:10.902540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1160/2312] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:12.138209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:12.147968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552841ae-baec-4b37-a6df-ace2cb19d92a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:12.151639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:12.155616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:12.155616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:12.155616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:12.155616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:12.170174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:12.171674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:12.185942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1153/2313] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:20.597502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:20.597989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:20.598095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:20.615538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:20.616740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:20.675552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1161/2314] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:20.841542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:20.843092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:20.916131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c85d6-6024-4093-8855-c47c30eba492 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:20.921305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:20.921981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:20.922297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:20.922578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:20.931185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:20.932810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:20.941414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1154/2315] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:36:24.321436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:24.322987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:24.339106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6971-0429-42c9-8a7c-d335b24a0c55 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:24.345324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:24.346114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:24.346329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:24.346562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:24.348377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:24.359499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:24.361509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:24.372503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1162/2316] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:25.217221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:25.218733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:25.235652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a5013-87ec-46fa-b232-92b19467be8d service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:25.241604 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:25.242288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:25.242642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:25.242931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:25.244756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:25.256151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:25.257751 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:25.267682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1155/2317] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:30.108929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:30.111197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:30.186105 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aef05-235a-4599-b267-dd9527b931d1 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:30.191022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:30.191924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:30.192218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:30.192503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] PATH_INFO: `/v3/users/d2d515a871294f81b122ecbaa4bf5a32` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:30.193829 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d515a871294f81b122ecbaa4bf5a32)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:30.195967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:30.224949 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:30.455270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d515a871294f81b122ecbaa4bf5a32'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:30.455943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d515a871294f81b122ecbaa4bf5a32'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:30.456538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d515a871294f81b122ecbaa4bf5a32'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:30.468323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d515a871294f81b122ecbaa4bf5a32'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:30.539886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d515a871294f81b122ecbaa4bf5a32'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:30.553198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1163/2318] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:36:30 2022] DELETE /identity/v3/users/d2d515a871294f81b122ecbaa4bf5a32 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:30.775550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:30.789575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5e6e-634c-4b6b-86da-8942c7ac7660 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:30.860103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:30.860977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:30.861264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:30.861574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] PATH_INFO: `/v3/projects/75f023fcd8c444e090e7d25e96e91963` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:30.863290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f023fcd8c444e090e7d25e96e91963)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:30.865262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:30.991805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f023fcd8c444e090e7d25e96e91963', 'request_id': 'req-4047408e-b909-4f97-8027-d0467e2d0c83'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.179900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f023fcd8c444e090e7d25e96e91963', 'request_id': 'req-4047408e-b909-4f97-8027-d0467e2d0c83'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.182658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:31.186969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f023fcd8c444e090e7d25e96e91963', 'request_id': 'req-4047408e-b909-4f97-8027-d0467e2d0c83'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.197555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] The token cache is being invalidate because project 75f023fcd8c444e090e7d25e96e91963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:36:31.197847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.198522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.200103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1156/2319] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:36:30 2022] DELETE /identity/v3/projects/75f023fcd8c444e090e7d25e96e91963 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:31.204551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:31.206052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:31.219884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208f02-4ca1-4501-a191-52fdff68354f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:31.285409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:31.286321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:31.286613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:31.286896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] PATH_INFO: `/v3/users/865382b3794c4598b871b55581963c79` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:31.288123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865382b3794c4598b871b55581963c79)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:31.290058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:31.516075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865382b3794c4598b871b55581963c79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.516820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865382b3794c4598b871b55581963c79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.517446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865382b3794c4598b871b55581963c79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.530210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865382b3794c4598b871b55581963c79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.614370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-79b7de36-8190-4729-ade4-dab9889fdd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865382b3794c4598b871b55581963c79'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:31.628465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1164/2320] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:36:31 2022] DELETE /identity/v3/users/865382b3794c4598b871b55581963c79 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:31.914399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:31.915869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:31.934598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047408e-b909-4f97-8027-d0467e2d0c83 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:31.996672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:31.998217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:31.998511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:31.998797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] PATH_INFO: `/v3/projects/fe655d4efb144bf3af2efa058d595494` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:31.999985 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe655d4efb144bf3af2efa058d595494)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:32.002221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:32.116386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe655d4efb144bf3af2efa058d595494', 'request_id': 'req-49ee425a-27df-4b1a-81f1-bc329347a0cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:32.207249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe655d4efb144bf3af2efa058d595494', 'request_id': 'req-49ee425a-27df-4b1a-81f1-bc329347a0cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:32.214309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe655d4efb144bf3af2efa058d595494', 'request_id': 'req-49ee425a-27df-4b1a-81f1-bc329347a0cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:32.225548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] The token cache is being invalidate because project fe655d4efb144bf3af2efa058d595494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:36:32.225842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:32.226517 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:32.228172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1157/2321] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:36:31 2022] DELETE /identity/v3/projects/fe655d4efb144bf3af2efa058d595494 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:41.624312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=18,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:42.222272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:47.611828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:47.612329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:47.612430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:47.632488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:47.633717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:47.693480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1165/2322] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:47.705460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:47.706922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:47.776209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee425a-27df-4b1a-81f1-bc329347a0cf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:47.782340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:47.782996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:47.783284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:47.783565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:47.792626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:47.794257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:47.802987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1158/2323] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:36:49.698070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:49.699804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:49.760523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73c0a-4a49-4857-9370-96797f5f6ae4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:49.764768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:49.765435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:49.765806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:49.766094 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:49.767948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:49.837855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:49.839503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:49.850882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1166/2324] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:49.936670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:49.947788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ea81-b9bc-4c34-8b5b-4ba2ba91b05d service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:49.952632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:49.954091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:49.954091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:49.954091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:49.956155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:49.968779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:49.970413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:49.980381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1159/2325] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:54.447789 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:54.450378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:54.520394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:54.540528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef12f6-c42c-472d-a090-20576d5b3f86 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:54.547327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:54.549747 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:54.549952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:54.550273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:54.552411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:54.619614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:54.621239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26d4a-9816-44e4-a4ed-924edf2cc05c service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:54.632506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1167/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:55.573117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:55.574774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:55.602566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93010d-5378-4451-8e0d-c193842265bc service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:55.629683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:55.630680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:55.631188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:55.632685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] PATH_INFO: `/v3/users/c0457bc532ce47aeabdec2643f53b4f6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:55.635133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0457bc532ce47aeabdec2643f53b4f6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:55.639008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:55.870697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0457bc532ce47aeabdec2643f53b4f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:55.871661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0457bc532ce47aeabdec2643f53b4f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:55.940077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0457bc532ce47aeabdec2643f53b4f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:55.954348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0457bc532ce47aeabdec2643f53b4f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:55.957361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6619051d-4d6f-4c07-81c5-94797fd4388f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0457bc532ce47aeabdec2643f53b4f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:56.002248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1160/2327] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:36:55 2022] DELETE /identity/v3/users/c0457bc532ce47aeabdec2643f53b4f6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:56.058439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.058906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.059152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.061827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1168/2328] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:36:56.068086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ea5-12ed-484c-88ae-c129bf4ca8cb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.068467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ea5-12ed-484c-88ae-c129bf4ca8cb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.068839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e8ea5-12ed-484c-88ae-c129bf4ca8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.134889 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fc4e8ea5-12ed-484c-88ae-c129bf4ca8cb None None] MFA Rules not processed for user `7ed1189200a44605a751549c6045f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:56.146173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fc4e8ea5-12ed-484c-88ae-c129bf4ca8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:56.256221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:56.266374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1161/2329] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:56.281403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:56.283410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:56.298560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c72ea-421b-40dd-be2d-7cfcc6f09bf0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:56.304107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:56.305060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.305574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.306077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.316186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:56.318076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f179bc-16e4-4a5e-99d8-99d26a05369a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:56.329103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1169/2330] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:56.469574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.469958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.470369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.471948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1162/2331] 10.222.0.61 () {54 vars in 921 bytes} [Mon Jul 4 09:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:36:56.486257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.486583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.487133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.531660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] MFA Rules not processed for user `b0991f43889c4092baff1a5a1099d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:56.531660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:56.628235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:56.631337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:56.634099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1170/2332] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Jul 4 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:56.661745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:56.678682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4d2c-7eb7-45c8-9a2f-3f76b82a7e44 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:56.683408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:56.684436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.685026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.685550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.701830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:56.705262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:56.753565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1171/2333] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:56.775074 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb5ea6-d29c-4c44-905e-6d2ef5d18d75 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:56.784785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:56.787042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:56.787530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:56.788028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] PATH_INFO: `/v3/projects/e97e5419f2ca4da6a620c3a0a40ebdf5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:56.789467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97e5419f2ca4da6a620c3a0a40ebdf5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:56.791513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:56.826509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:56.828271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:56.923265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:56.940381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed49c-9a68-4524-9136-a0fdbc28cc97 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:56.952997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97e5419f2ca4da6a620c3a0a40ebdf5', 'request_id': 'req-2e47de7c-2993-4d29-b165-ce51e0852b05'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:57.031589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.032212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.032502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.032783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.035264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:57.050801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.052685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee9e1-dac2-4d7d-9fcd-4b24249f3b86 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.064926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1172/2334] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:57.095184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97e5419f2ca4da6a620c3a0a40ebdf5', 'request_id': 'req-2e47de7c-2993-4d29-b165-ce51e0852b05'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:57.104028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97e5419f2ca4da6a620c3a0a40ebdf5', 'request_id': 'req-2e47de7c-2993-4d29-b165-ce51e0852b05'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:57.126160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] The token cache is being invalidate because project e97e5419f2ca4da6a620c3a0a40ebdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:36:57.126739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:57.129709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e47de7c-2993-4d29-b165-ce51e0852b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:36:57.134547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1163/2335] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:36:56 2022] DELETE /identity/v3/projects/e97e5419f2ca4da6a620c3a0a40ebdf5 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:36:57.137046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.137348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.137638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.165492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:57.167046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:57.275995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1173/2336] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:57.277975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.278468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.279019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.310091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:57.311840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:57.324403 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1164/2337] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:57.327870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.337402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad253c-3d4a-477a-9397-a96cddc6b156 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.343540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.344428 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.355145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.356613 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.358104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:36:57.358271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.361032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.383664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1174/2338] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:36:57.388691 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.398957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f879adc-5312-4e66-a933-966de191cb9a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.404956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.405767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.406152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.406564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.407629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.409737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.525305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1165/2339] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:36:57 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:36:57.528442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.544202 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c2e7-e460-4fc4-aff7-7adfad2c808a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.637840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.638628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.639073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.640765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.640765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.642268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.739381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1175/2340] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:36:57 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:36:57.740276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.752264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597f29-fc0c-4e4b-9aca-d6bdd04b4d1e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.757710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.758507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.758784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.759060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.759820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.761522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.773657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1166/2341] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:36:57.778234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.791652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76e18f-2296-4d61-82e3-551e7e81554b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.797413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.801821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.801821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.801821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.801821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.801821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af3bf6-87f9-4949-a77b-7a939a81a4f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.803061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:57.814244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1176/2342] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:36:57.818147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:57.829845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022ee2-2423-436f-a953-98d4e7d17383 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:57.836223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909da36-d239-4883-8295-97865e81494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:57.837204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909da36-d239-4883-8295-97865e81494f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.837563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909da36-d239-4883-8295-97865e81494f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.837947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909da36-d239-4883-8295-97865e81494f admin admin] PATH_INFO: `/v3/projects/fb63b9de212a416ab2aebf97b37b4eb0/users/d781f0ce810e42f8ae6308784face2d4/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.859572 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909da36-d239-4883-8295-97865e81494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb63b9de212a416ab2aebf97b37b4eb0, user_id=d781f0ce810e42f8ae6308784face2d4, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:57.863773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909da36-d239-4883-8295-97865e81494f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:57.941278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1167/2343] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:36:57 2022] PUT /identity/v3/projects/fb63b9de212a416ab2aebf97b37b4eb0/users/d781f0ce810e42f8ae6308784face2d4/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:36:57.951967 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:57.952371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:57.952775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:57.986356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] MFA Rules not processed for user `d781f0ce810e42f8ae6308784face2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:57.988623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:58.073870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1177/2344] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:58.075496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909da36-d239-4883-8295-97865e81494f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:58.112650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:58.179779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909da36-d239-4883-8295-97865e81494f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:58.186937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:58.190328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:58.190715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:58.191069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:58.192994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:58.196600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:58.362891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1168/2345] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:36:58 2022] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:36:58.366819 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:58.380321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce60d-33c3-4e74-bc49-81b7df1ff643 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:58.450328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:58.455129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:58.455438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:58.455808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:58.456707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:58.458848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:58.734950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1178/2346] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:36:58 2022] POST /identity/v3/users => generated 289 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:36:58.739025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:58.749792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e763-4de2-4cda-9f05-eb1407d0a951 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:58.754905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:58.755621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:58.755911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:58.756246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:58.756990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:58.758719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:58.777532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1169/2347] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:36:58.779448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:58.793561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1f7ae-3f02-4eb6-8a96-106b4c37333a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:58.807625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:58.809111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:58.809611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:58.810117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] PATH_INFO: `/v3/projects/f4faf65cf119404c9690e40102d75d2d/users/7479b2ceb3e7451798675eb784cb88ac/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:58.836605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4faf65cf119404c9690e40102d75d2d, user_id=7479b2ceb3e7451798675eb784cb88ac, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:58.839567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:58.907180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1179/2348] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:36:58 2022] PUT /identity/v3/projects/f4faf65cf119404c9690e40102d75d2d/users/7479b2ceb3e7451798675eb784cb88ac/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:58.911831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:58.925134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3553843-91f5-43cf-9d29-b891ec186c57 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:59.002268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:59.003016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:59.003307 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:59.003593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:59.004342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:59.006006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602cf09-06af-4284-b625-7cfccc651aaf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:59.018077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1170/2349] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:36:59.022476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:59.034855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d484-f1c2-4c1b-afe4-e11601bdddb3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:59.042029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:59.043065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:59.043291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:59.043671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] PATH_INFO: `/v3/projects/f4faf65cf119404c9690e40102d75d2d/users/7479b2ceb3e7451798675eb784cb88ac/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:59.045922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4faf65cf119404c9690e40102d75d2d, user_id=7479b2ceb3e7451798675eb784cb88ac, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:59.048858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:59.061516 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1180/2350] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:36:59 2022] PUT /identity/v3/projects/f4faf65cf119404c9690e40102d75d2d/users/7479b2ceb3e7451798675eb784cb88ac/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:36:59.072189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:59.072493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:59.073030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:59.104425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] MFA Rules not processed for user `7479b2ceb3e7451798675eb784cb88ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:36:59.106301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:59.189116 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1171/2351] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:36:59.201666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:59.204079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:36:59.258986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:59.275821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b93931-762d-4716-972a-d63b4253a4c5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:59.279662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:59.280317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:59.280606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:59.281106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:59.292600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:59.294306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:59.305096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1181/2352] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:36:59.661975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:36:59.676167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9097-4f62-4ef2-96e3-90795c92852b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:36:59.680034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:36:59.680841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:36:59.681154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:36:59.681429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:36:59.701808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:36:59.743463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:36:59.744923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:36:59.762236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1172/2353] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:01.267366 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:01.269426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:01.362496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820747-17a3-4e59-8ab0-2bf12fbb9803 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:01.369010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:01.369676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:01.369965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:01.370276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:01.372426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:01.385741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:01.387303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:01.402144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1182/2354] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:04.235856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:04.237761 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:04.254942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19e7f-5cff-43c3-9624-b7bf8cfbbd1a service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:04.260983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:04.261955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:04.262389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:04.263410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:04.265454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:04.288931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:04.290629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadcbed-b665-43fb-b98c-42c2d153703e service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:04.308043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1173/2355] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:09.309537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:09.383417 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227a2e-7a1b-43aa-af17-c76950a46fc0 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:09.389291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:09.390390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:09.390683 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:09.390970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] PATH_INFO: `/v3/users/d781f0ce810e42f8ae6308784face2d4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:09.392240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d781f0ce810e42f8ae6308784face2d4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:09.394224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:09.689780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd781f0ce810e42f8ae6308784face2d4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:09.690567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd781f0ce810e42f8ae6308784face2d4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:09.691413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd781f0ce810e42f8ae6308784face2d4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:09.725589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd781f0ce810e42f8ae6308784face2d4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:09.730665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:09.877751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd781f0ce810e42f8ae6308784face2d4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:09.908405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1183/2356] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:09 2022] DELETE /identity/v3/users/d781f0ce810e42f8ae6308784face2d4 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:09.924504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:09.925531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:09.925974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:09.964991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:09.966830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:10.060564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1174/2357] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:10.073888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:10.078559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:10.143662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497050f4-79da-4721-bbde-02ec82a7c765 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:10.147470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:10.148152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:10.148444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:10.148721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:10.159176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:10.160850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:10.171183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1184/2358] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:10.902617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:10.904445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:10.933569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502e6f8-c0a3-44c8-b9aa-01f48e76e42f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:10.940184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:10.941129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:10.941531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:10.941878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] PATH_INFO: `/v3/projects/fb63b9de212a416ab2aebf97b37b4eb0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:10.943416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb63b9de212a416ab2aebf97b37b4eb0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:10.959863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:11.074721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb63b9de212a416ab2aebf97b37b4eb0', 'request_id': 'req-aaefe452-1146-48bc-a71d-85597d6da9d2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.151756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb63b9de212a416ab2aebf97b37b4eb0', 'request_id': 'req-aaefe452-1146-48bc-a71d-85597d6da9d2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.159355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb63b9de212a416ab2aebf97b37b4eb0', 'request_id': 'req-aaefe452-1146-48bc-a71d-85597d6da9d2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.171741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] The token cache is being invalidate because project fb63b9de212a416ab2aebf97b37b4eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:11.172035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.172710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.174338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1175/2359] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:10 2022] DELETE /identity/v3/projects/fb63b9de212a416ab2aebf97b37b4eb0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:11.178576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:11.189280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e185-3f6c-4666-b486-121c7c8ebbab service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:11.257130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:11.258127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:11.258449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:11.258783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] PATH_INFO: `/v3/users/7479b2ceb3e7451798675eb784cb88ac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:11.260975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7479b2ceb3e7451798675eb784cb88ac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:11.264172 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:11.480034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7479b2ceb3e7451798675eb784cb88ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.480693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7479b2ceb3e7451798675eb784cb88ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.481306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7479b2ceb3e7451798675eb784cb88ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.494438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7479b2ceb3e7451798675eb784cb88ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.578698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4ab3c8d-3366-4981-a169-b4860d2e2f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7479b2ceb3e7451798675eb784cb88ac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:11.592667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1185/2360] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:11 2022] DELETE /identity/v3/users/7479b2ceb3e7451798675eb784cb88ac => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:12.269297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:12.271462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:12.287745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefe452-1146-48bc-a71d-85597d6da9d2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:12.319792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:12.371331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:12.371331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:12.371331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:12.371331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] PATH_INFO: `/v3/projects/f4faf65cf119404c9690e40102d75d2d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:12.371734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4faf65cf119404c9690e40102d75d2d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:12.371734 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:12.521726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4faf65cf119404c9690e40102d75d2d', 'request_id': 'req-914d29c9-9fd7-4154-86a6-4e01d3ed9227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:12.603162 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4faf65cf119404c9690e40102d75d2d', 'request_id': 'req-914d29c9-9fd7-4154-86a6-4e01d3ed9227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:12.613061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4faf65cf119404c9690e40102d75d2d', 'request_id': 'req-914d29c9-9fd7-4154-86a6-4e01d3ed9227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:12.634855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] The token cache is being invalidate because project f4faf65cf119404c9690e40102d75d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:12.634855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:12.634855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-914d29c9-9fd7-4154-86a6-4e01d3ed9227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:12.636606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1176/2361] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:12 2022] DELETE /identity/v3/projects/f4faf65cf119404c9690e40102d75d2d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:12.643285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:12.643837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:12.644185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:12.663544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:12.675153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:12.677318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:12.759117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1186/2362] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:12.766850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:12.767173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:12.771217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:12.787390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:12.788675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:12.797764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1177/2363] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:12.802533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:12.814242 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165a71-6955-4319-8cb4-e02e9443861b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:12.820382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:12.831343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:12.837277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1187/2364] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:12.842210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:12.851575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be302-3b9f-4895-95b8-08ec35210948 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:12.856292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:12.857496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:12.857777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:12.858054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:12.858825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:12.860737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4b7ed-535f-48bb-90e6-12ae564af2e5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.034720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1178/2365] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:12 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:13.044208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.055122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793865d7-8620-41ea-be27-c1abfe2531de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.153145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.154524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.154857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.155145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.155868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.157863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.213069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.213359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.213641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.234450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:13.234450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:13.285183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1188/2366] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:13 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:13.286230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.297349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346b2a-cfb6-4e12-90fb-59974e047e44 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.301829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1179/2367] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:13.303837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.304577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.304863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.305137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.305884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.307753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.316120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.317536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:13.324773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1189/2368] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:13.326439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.336503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2dedc-913d-490c-8efd-0512a78e75e0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.341319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.342008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.342335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.342628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.343354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.344971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.362969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:13.363325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1190/2369] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:13.367342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.377876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f856642-26b7-45f3-8e17-3adf08d7217e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.382680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.383578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.387355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.387355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] PATH_INFO: `/v3/projects/f5221da71f364937a26068a79377d552/users/ab769bc1eedb4b2f94eecc006deddc55/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.395262 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf6a5-55a5-4cf8-949d-87e8189975e5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.400826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5221da71f364937a26068a79377d552, user_id=ab769bc1eedb4b2f94eecc006deddc55, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.403591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.405982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.406748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.407160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.407477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.416966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.418705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c393f9-af28-4bb7-b699-ac5e763f216b service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.426754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1180/2370] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:37:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 09:37:13.518906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1191/2371] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:13 2022] PUT /identity/v3/projects/f5221da71f364937a26068a79377d552/users/ab769bc1eedb4b2f94eecc006deddc55/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:13.530826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.531483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.531969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.574896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] MFA Rules not processed for user `ab769bc1eedb4b2f94eecc006deddc55`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:13.576953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:13.650244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1181/2372] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:13.656716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.741333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:13.788303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37188259-2673-491a-9b28-e315c286f51c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:13.800548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:13.801494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:13.801811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:13.802141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:13.803002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:13.805205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:13.948080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1192/2373] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:13.953422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:13.978873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec863-06f9-4428-b470-7a7cfd797448 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:14.140418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:14.141173 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.141468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.141756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.142564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:14.145672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:14.257257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1182/2374] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:13 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:14.261879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:14.281188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dba715-0cf7-4a39-b6ef-05307ebdb7e0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:14.288218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:14.288904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.289185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.289456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.290218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:14.292846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:14.310103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1193/2375] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:14.311211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:14.322022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb622f-8648-4619-9bd8-14f00c94f039 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:14.331059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:14.332777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.334284 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.334671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] PATH_INFO: `/v3/projects/356fa5bd18024b9ba054bc1235623d13/users/94f9f15a65094709b4b4f9127ee29e5e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.371583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356fa5bd18024b9ba054bc1235623d13, user_id=94f9f15a65094709b4b4f9127ee29e5e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:14.386523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:14.547640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1183/2376] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:14 2022] PUT /identity/v3/projects/356fa5bd18024b9ba054bc1235623d13/users/94f9f15a65094709b4b4f9127ee29e5e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:14.551881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:14.563024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9fa77-6180-4a34-bfae-26c410042bf1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:14.688814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:14.690270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.690750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.691189 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.692106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:14.696000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01a3e2-9b46-469e-8ccb-26afe539e137 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:14.718714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1194/2377] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:14.719422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:14.731995 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f67f84-f073-4eb6-93f3-b55755af73c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:14.738445 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:14.739518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.739804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.740294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] PATH_INFO: `/v3/projects/356fa5bd18024b9ba054bc1235623d13/users/94f9f15a65094709b4b4f9127ee29e5e/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.742524 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356fa5bd18024b9ba054bc1235623d13, user_id=94f9f15a65094709b4b4f9127ee29e5e, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:14.745500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:14.768702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1184/2378] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:14 2022] PUT /identity/v3/projects/356fa5bd18024b9ba054bc1235623d13/users/94f9f15a65094709b4b4f9127ee29e5e/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:14.771365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:14.779766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:14.779766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:14.805224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] MFA Rules not processed for user `94f9f15a65094709b4b4f9127ee29e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:14.806786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:14.927476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1195/2379] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:14.941131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:14.942937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:14.960688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:15.061707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07074-635e-4da7-b36c-a661ebce7985 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:15.067612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:15.068390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:15.068757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:15.069115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:15.087058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:15.089395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2a64-44ca-42ff-97aa-84c1a22fab19 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:15.102355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1185/2380] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:15.156553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:15.223682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:15.262018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676c72-e1d3-4467-be15-1e1a8915b772 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:15.267437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:15.268348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:15.268640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:15.268925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] PATH_INFO: `/v3/users/ab769bc1eedb4b2f94eecc006deddc55` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:15.270277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab769bc1eedb4b2f94eecc006deddc55)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:15.272241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:15.536521 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab769bc1eedb4b2f94eecc006deddc55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:15.537325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab769bc1eedb4b2f94eecc006deddc55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:15.538005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab769bc1eedb4b2f94eecc006deddc55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:15.551632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab769bc1eedb4b2f94eecc006deddc55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:15.637126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab769bc1eedb4b2f94eecc006deddc55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:15.652168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1196/2381] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:15 2022] DELETE /identity/v3/users/ab769bc1eedb4b2f94eecc006deddc55 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:15.657629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:15.658112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:15.658455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:15.696179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:15.697847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:15.776405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1186/2382] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:15.787232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:15.789482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:15.883528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b491eb-09f7-4632-8ed3-7c439f8570b3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:15.888187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:15.889555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:15.889850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:15.890229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:15.901481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:15.903017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:15.919751 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1197/2383] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:16.553269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:16.554902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:16.568787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6432-0c51-4f49-8500-74368f6c3c6b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:16.573648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:16.574864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:16.575799 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:16.576297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] PATH_INFO: `/v3/projects/f5221da71f364937a26068a79377d552` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:16.577764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5221da71f364937a26068a79377d552)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:16.582345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:16.709666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5221da71f364937a26068a79377d552', 'request_id': 'req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:16.763004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5221da71f364937a26068a79377d552', 'request_id': 'req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:16.775233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5221da71f364937a26068a79377d552', 'request_id': 'req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:16.788794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] The token cache is being invalidate because project f5221da71f364937a26068a79377d552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:16.789372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:16.791538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:16.796880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1187/2384] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:16 2022] DELETE /identity/v3/projects/f5221da71f364937a26068a79377d552 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:16.799958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:16.813667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3a41-e9c2-4c94-9785-9c2216b431a5 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:16.899531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:16.907509 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:16.909589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:16.909589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:16.909589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] PATH_INFO: `/v3/users/94f9f15a65094709b4b4f9127ee29e5e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:16.910568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f9f15a65094709b4b4f9127ee29e5e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:16.915897 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:17.182131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f9f15a65094709b4b4f9127ee29e5e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:17.182823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f9f15a65094709b4b4f9127ee29e5e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:17.183489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f9f15a65094709b4b4f9127ee29e5e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:17.196701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f9f15a65094709b4b4f9127ee29e5e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:17.245553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2c92a3e5-7a92-4f37-b097-1bce2dd79388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f9f15a65094709b4b4f9127ee29e5e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:17.262261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1198/2385] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:16 2022] DELETE /identity/v3/users/94f9f15a65094709b4b4f9127ee29e5e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:17.911821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:17.913490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:17.941571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd55d48-5925-40e9-bb00-9292bc7c8cbb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:17.977370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:18.007161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:18.008138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.008525 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.008808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] PATH_INFO: `/v3/projects/356fa5bd18024b9ba054bc1235623d13` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.010020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=356fa5bd18024b9ba054bc1235623d13)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:18.011994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:18.138363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356fa5bd18024b9ba054bc1235623d13', 'request_id': 'req-f21c75c0-1be2-44ef-ab98-10d9430cac3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:18.238120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356fa5bd18024b9ba054bc1235623d13', 'request_id': 'req-f21c75c0-1be2-44ef-ab98-10d9430cac3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:18.245822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356fa5bd18024b9ba054bc1235623d13', 'request_id': 'req-f21c75c0-1be2-44ef-ab98-10d9430cac3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:18.271622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] The token cache is being invalidate because project 356fa5bd18024b9ba054bc1235623d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:18.271886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:18.272514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f21c75c0-1be2-44ef-ab98-10d9430cac3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:18.275023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1188/2386] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:17 2022] DELETE /identity/v3/projects/356fa5bd18024b9ba054bc1235623d13 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:18.279633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.280093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.280185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.301141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:18.302490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:18.440421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1199/2387] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:18.451489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.457223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.457223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.477182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:18.478527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:18.492562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1189/2388] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:18.497438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:18.515341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ecd6-4d99-4e24-929d-f6c34e1b0d4a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:18.521144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:18.521872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.522257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.522631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.523488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:18.523821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:18.534605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:18.548435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1200/2389] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:18.553037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:18.563513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9912d74-3149-4bbf-b4d8-921206f4ca5c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:18.568350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:18.569018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.569310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.569588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.570310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:18.572254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:18.728625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1190/2390] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:18 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:18.729306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:18.742129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8073-b4b5-4075-8508-d110c597e598 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:18.823555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:18.824356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.824650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.826135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.826951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:18.829520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:18.838776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:18.962170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1201/2391] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:18 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:18.964148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:18.976566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71ec06-da60-4028-9cb2-b84579ffaa6e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:18.981355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:18.982032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:18.982351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:18.982635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:18.983379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:18.985076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:18.996820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1191/2392] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:19.000993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.012982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b07bed-c9da-470d-aa27-cebe30727545 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.018319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.019076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.019381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.019734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.020716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.022811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94664c-ed59-42b2-80cb-ab9783e9e965 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.039262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1202/2393] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:19.040728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.052224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823fed-8d54-4dd3-8169-d1d27e6d95ca admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.058123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.061618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.061618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.061618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] PATH_INFO: `/v3/projects/70dcc0e697724abfb651a18b0fad6b38/users/27ce1311f2fe4404bde8199fc816976d/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.077257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dcc0e697724abfb651a18b0fad6b38, user_id=27ce1311f2fe4404bde8199fc816976d, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.080213 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.189605 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1192/2394] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:19 2022] PUT /identity/v3/projects/70dcc0e697724abfb651a18b0fad6b38/users/27ce1311f2fe4404bde8199fc816976d/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:19.199911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.200285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.200590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.229825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] MFA Rules not processed for user `27ce1311f2fe4404bde8199fc816976d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:19.231083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:19.307545 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1203/2395] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:19.312582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.378298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:19.394176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e422-5b8b-4757-b0e7-7c3111e35f9b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.404178 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.405022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.405473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.413253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.413253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.413253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.529720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1193/2396] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:19 2022] POST /identity/v3/projects => generated 401 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:19.534165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.545970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f73e-c833-4082-bd28-b903ad725729 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.608629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.609477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.609785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.610118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.610932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.613117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.733042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1204/2397] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:19 2022] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:19.733903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.749355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2610c2f-ae2f-402d-a311-f73367d178cf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.760762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.761777 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.762070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.762929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.763681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.771615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.786268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1194/2398] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:19.792239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.804208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfd426-531c-4b06-a9b9-7ef79646b6c0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:19.810133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:19.811817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:19.812212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:19.812653 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] PATH_INFO: `/v3/projects/a46efb27cfe64c1a87f42e4608035530/users/3ce0569a26f4483bbe58c4131fa02d40/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:19.834798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46efb27cfe64c1a87f42e4608035530, user_id=3ce0569a26f4483bbe58c4131fa02d40, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:19.837703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:19.867466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.869315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:19.920551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1205/2399] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:19 2022] PUT /identity/v3/projects/a46efb27cfe64c1a87f42e4608035530/users/3ce0569a26f4483bbe58c4131fa02d40/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:19.924924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:19.949717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba4f7-ec72-46d5-bc58-f2400a4431e1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:20.004079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:20.024181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:20.025463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.026035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.026487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.028658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:20.077118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1804b88-de20-4c1c-a838-06b93f997062 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:20.089243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:20.090006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.090416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.091367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.092243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:20.093994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:20.120476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1206/2400] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:20.122734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:20.129818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:20.132298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89e818-09d3-4ed6-b39a-5a6e53e38385 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:20.140914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1ee4-d289-40a6-8ea9-d086fb930d12 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:20.145575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1195/2401] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:20.150427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:20.151793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.152235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.153698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] PATH_INFO: `/v3/projects/a46efb27cfe64c1a87f42e4608035530/users/3ce0569a26f4483bbe58c4131fa02d40/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.156564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46efb27cfe64c1a87f42e4608035530, user_id=3ce0569a26f4483bbe58c4131fa02d40, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:20.164444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:20.174247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1207/2402] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:20 2022] PUT /identity/v3/projects/a46efb27cfe64c1a87f42e4608035530/users/3ce0569a26f4483bbe58c4131fa02d40/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:20.183789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.184132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.184386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.228355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] MFA Rules not processed for user `3ce0569a26f4483bbe58c4131fa02d40`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:20.229733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:20.278901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:20.398455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1196/2403] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:20.415783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:20.417846 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:20.509306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b651-24f2-476a-ac78-027eab2ea73a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:20.515479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:20.515479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.515975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.516076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.529198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:20.530998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:20.546299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1208/2404] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:20.813211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:20.826967 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc32e1b-dd4d-4b4f-a650-911a2d1ade6a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:20.831192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:20.832250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:20.832707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:20.833166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:20.910658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:20.912602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:20.924849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1197/2405] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:24.862254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:24.863845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:24.937414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3007-de22-48ee-b60f-b67996878b07 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:24.942257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:24.943142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:24.943620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:24.943907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] PATH_INFO: `/v3/users/252b0cfb5934429ba31adc44ee4a556e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:24.945796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252b0cfb5934429ba31adc44ee4a556e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:24.947779 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:25.137060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252b0cfb5934429ba31adc44ee4a556e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:25.138285 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252b0cfb5934429ba31adc44ee4a556e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:25.138914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252b0cfb5934429ba31adc44ee4a556e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:25.151187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:25.152580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252b0cfb5934429ba31adc44ee4a556e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:25.288452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e8fbe3fa-c8f1-4fbb-af98-5c80ff0092c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252b0cfb5934429ba31adc44ee4a556e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:25.301947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1209/2406] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:24 2022] DELETE /identity/v3/users/252b0cfb5934429ba31adc44ee4a556e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:25.535670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:25.547477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f6fa-f649-406d-9b69-b1f82f238fc8 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:25.613858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:25.615161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:25.615661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:25.616126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] PATH_INFO: `/v3/projects/6a218baf28d0416e88cc752284d3d838` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:25.617911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a218baf28d0416e88cc752284d3d838)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:25.621678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:26.608369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a218baf28d0416e88cc752284d3d838', 'request_id': 'req-9fb6b1bb-20c5-4b96-888d-c3b514103689'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:26.688500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a218baf28d0416e88cc752284d3d838', 'request_id': 'req-9fb6b1bb-20c5-4b96-888d-c3b514103689'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:26.691194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:26.699614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a218baf28d0416e88cc752284d3d838', 'request_id': 'req-9fb6b1bb-20c5-4b96-888d-c3b514103689'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:26.712736 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] The token cache is being invalidate because project 6a218baf28d0416e88cc752284d3d838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:26.714169 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:26.714507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fb6b1bb-20c5-4b96-888d-c3b514103689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:26.716193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1198/2407] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:25 2022] DELETE /identity/v3/projects/6a218baf28d0416e88cc752284d3d838 => generated 0 bytes in 1181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:26.733797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:26.733797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:26.733797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:26.741504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:26.742750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:26.806264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1210/2408] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:26.822028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:26.822430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:26.822726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:26.823437 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:26.824852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:26.836489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69135b5-8f81-4f83-adbf-2ba0db09e7e5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:26.848106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:26.848106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:26.848106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:26.848106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] PATH_INFO: `/v3/users/27ce1311f2fe4404bde8199fc816976d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:26.848530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:26.848663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce1311f2fe4404bde8199fc816976d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:26.848764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:26.848862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:26.854043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1199/2409] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:26.858647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:26.868507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c40668-8223-4618-97eb-a6e844c23b38 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:26.873466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:26.874137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:26.874466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:26.874767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:26.875716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:26.876055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:26.877933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:26.890618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1200/2410] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:26.895352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:26.905970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e886-e999-4d67-9339-192433f3acba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:26.910838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:26.911438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:26.911724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:26.912002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:26.912692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:26.914651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.028514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1201/2411] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:26 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:27.033018 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.091697 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce1311f2fe4404bde8199fc816976d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:27.092391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce1311f2fe4404bde8199fc816976d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:27.093117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce1311f2fe4404bde8199fc816976d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:27.093658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440af7-b9f3-44e9-a919-c5dc977fa35d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.099320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.100527 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.101224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.102114 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.103783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.106863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce1311f2fe4404bde8199fc816976d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:27.107194 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.207050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-92abc481-701e-47a7-9e5a-936dc6f22cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce1311f2fe4404bde8199fc816976d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:27.214636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1202/2412] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:27 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:27.227716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.227716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:27.227941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1211/2413] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:26 2022] DELETE /identity/v3/users/27ce1311f2fe4404bde8199fc816976d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:27.228048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.228412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.228665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.233688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564fd9-1a29-42fc-95c0-06a004df6279 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.247132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:27.248416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:27.297902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.298727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.299013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.299292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.300438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:27.300592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.302693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.315800 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1212/2414] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:27.319716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1203/2415] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:27.321267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.327056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.329134 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:27.332532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1632c-7efc-4fd1-b711-66aa61415ea6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.338006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.338792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.339262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.339505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.340920 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.342654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.353053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1213/2416] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:27.357224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.363095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:27.367612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb2bec-e178-42e8-8035-7e372a03640d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.372272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.377104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.377104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.377104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] PATH_INFO: `/v3/projects/3b1e7edea4744b77a7777b04cf2ee459/users/48d409311f7f435cb6949088e6ec1697/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.392714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7678c8-e2df-4c61-9382-24ac2636eb1d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.393076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1e7edea4744b77a7777b04cf2ee459, user_id=48d409311f7f435cb6949088e6ec1697, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.395758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.398701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.400021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.400021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.400021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.414702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.416195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e5c2-e38f-4006-a754-c9815acdb7e1 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.426507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1204/2417] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:27.535240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1214/2418] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:27 2022] PUT /identity/v3/projects/3b1e7edea4744b77a7777b04cf2ee459/users/48d409311f7f435cb6949088e6ec1697/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:27.546755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.547048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.547329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.577437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] MFA Rules not processed for user `48d409311f7f435cb6949088e6ec1697`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:27.578770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:27.656913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1205/2419] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:27.661444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.758081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8299f1-ab45-46cf-903a-2d237a934b68 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.775292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.775292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.775292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.775292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.775904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.775904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:27.869225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1215/2420] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:27 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:27.870463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:27.883305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277acadb-279d-4da1-9b18-3559c79bae15 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:27.947390 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:27.948073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:27.948366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:27.948647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:27.949349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:27.951362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.046518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1206/2421] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:27 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:28.048793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.076772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758635c-0436-4929-98dc-e2ea981f0aff admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.076772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.077931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.078399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.080134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.081309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.081430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.083339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.083618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.096476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1216/2422] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:28.106805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.107835 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0129-f83e-4b00-b75b-652d363feafc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.115574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac08f0-08c4-4165-89ba-38e9c7c54686 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.116003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.117261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.117706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.118680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] PATH_INFO: `/v3/projects/70dcc0e697724abfb651a18b0fad6b38` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.121042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dcc0e697724abfb651a18b0fad6b38)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.123979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.135603 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.137028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.138262 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.139584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] PATH_INFO: `/v3/projects/582af92228a242b8ad607b55b27d33c9/users/5632e6f82b604f0d807b76614db10cd5/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.156893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582af92228a242b8ad607b55b27d33c9, user_id=5632e6f82b604f0d807b76614db10cd5, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.159950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.300851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1217/2423] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:28 2022] PUT /identity/v3/projects/582af92228a242b8ad607b55b27d33c9/users/5632e6f82b604f0d807b76614db10cd5/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:28.304762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.307223 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:28.310884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dcc0e697724abfb651a18b0fad6b38', 'request_id': 'req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.367483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d62da-9071-464e-aa6d-b68cfb214ab2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.379091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:28.425873 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dcc0e697724abfb651a18b0fad6b38', 'request_id': 'req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.431704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.432388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.432678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.432956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.433691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.435433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.436567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dcc0e697724abfb651a18b0fad6b38', 'request_id': 'req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.449364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1218/2424] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:28.449593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] The token cache is being invalidate because project 70dcc0e697724abfb651a18b0fad6b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:28.449593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.450531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.451027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.455747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1207/2425] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:28 2022] DELETE /identity/v3/projects/70dcc0e697724abfb651a18b0fad6b38 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:28.455946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.456952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.459708 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.472465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac12ed-e570-4b5b-8b51-9830ffde2d49 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.482023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.483209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.483580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.483936 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] PATH_INFO: `/v3/projects/582af92228a242b8ad607b55b27d33c9/users/5632e6f82b604f0d807b76614db10cd5/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.486349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582af92228a242b8ad607b55b27d33c9, user_id=5632e6f82b604f0d807b76614db10cd5, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.486760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024761c-ced2-4e0c-bbd2-4cf88c81a2c3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.489546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4c3c-4c34-4996-985b-32b5b53cd760 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.491900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.492819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.493107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.493384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] PATH_INFO: `/v3/users/3ce0569a26f4483bbe58c4131fa02d40` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.499702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce0569a26f4483bbe58c4131fa02d40)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.503371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.507780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1219/2426] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:28 2022] PUT /identity/v3/projects/582af92228a242b8ad607b55b27d33c9/users/5632e6f82b604f0d807b76614db10cd5/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:28.517927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.518456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.518900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.554310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] MFA Rules not processed for user `5632e6f82b604f0d807b76614db10cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:28.555611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.629393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1220/2427] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:28.641585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.643902 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.693539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce0569a26f4483bbe58c4131fa02d40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.694260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce0569a26f4483bbe58c4131fa02d40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.709370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbf59e-46b1-4e01-9a9f-d764d8823dfe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:28.714310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:28.715299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.716235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.716625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.719024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.733283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:28.735513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98489ffc-e46c-4008-a03b-741e47cfc9f1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:28.746528 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1221/2428] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:28.760702 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:28.761261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:28.761261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:28.763824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce0569a26f4483bbe58c4131fa02d40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.776103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce0569a26f4483bbe58c4131fa02d40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.777581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce0569a26f4483bbe58c4131fa02d40'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:28.783313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:28.784550 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:28.802981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1208/2429] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:28 2022] DELETE /identity/v3/users/3ce0569a26f4483bbe58c4131fa02d40 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:28.815618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:28.877393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1222/2430] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:37:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:28.906000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:28.907539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:29.008241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87681db8-cd57-43cc-a4e7-32b82cfff89e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:29.015929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:29.016610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.016901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.017183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.091051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:29.107115 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:29.108956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c73f4-4399-4d7f-83b9-d98a89623601 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:29.121958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1209/2431] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:37:29.358222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:29.359714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:29.436982 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0f04-2acb-4ea4-aeb4-e1e9acd5201e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:29.508644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:29.510426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.510640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.510941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] PATH_INFO: `/v3/projects/a46efb27cfe64c1a87f42e4608035530` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.512233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46efb27cfe64c1a87f42e4608035530)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:29.514203 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:29.620910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46efb27cfe64c1a87f42e4608035530', 'request_id': 'req-d197586e-39c5-4be2-a5d9-54ad47c07e37'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:29.689042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46efb27cfe64c1a87f42e4608035530', 'request_id': 'req-d197586e-39c5-4be2-a5d9-54ad47c07e37'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:29.695341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46efb27cfe64c1a87f42e4608035530', 'request_id': 'req-d197586e-39c5-4be2-a5d9-54ad47c07e37'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:29.707457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] The token cache is being invalidate because project a46efb27cfe64c1a87f42e4608035530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:29.707750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:29.708409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:29.709956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1223/2432] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:29 2022] DELETE /identity/v3/projects/a46efb27cfe64c1a87f42e4608035530 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:29.714909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf955c-7785-40fb-927d-1876fdb2a93b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.715746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf955c-7785-40fb-927d-1876fdb2a93b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.716584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf955c-7785-40fb-927d-1876fdb2a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.734823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-92cf955c-7785-40fb-927d-1876fdb2a93b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:29.736179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-92cf955c-7785-40fb-927d-1876fdb2a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:29.780695 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:29.782131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:29.793090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:29.805767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1210/2433] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:29.814472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.814851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.815138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.832887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:29.834104 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:29.842750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1211/2434] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:29.846896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:29.851255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197586e-39c5-4be2-a5d9-54ad47c07e37 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:29.856467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55f4a-7211-4580-bf86-b09810eae149 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:29.856654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:29.857524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.857806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.858142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] PATH_INFO: `/v3/users/48d409311f7f435cb6949088e6ec1697` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.859367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d409311f7f435cb6949088e6ec1697)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:29.861292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:29.861414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:29.861940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.862265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.862547 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.863275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:29.863586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:29.865189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:29.881378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1212/2435] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:29.882119 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:29.891789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735c1cc-e689-42b6-bdea-b5411a1cf15b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:29.896490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:29.897132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:29.897425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:29.897707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:29.898420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:29.900334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.021560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1213/2436] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:29 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:30.025212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.090061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e9fb9-8aa0-4613-9fc0-2401c343c157 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.096327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.097376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.097669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.098012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.098740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.100696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.136609 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d409311f7f435cb6949088e6ec1697'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:30.137310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d409311f7f435cb6949088e6ec1697'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:30.137958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d409311f7f435cb6949088e6ec1697'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:30.150482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d409311f7f435cb6949088e6ec1697'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:30.212196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1214/2437] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:30 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:30.216027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.217764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.236147 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075c7c-9f01-4c64-9131-dccee6ba6c1b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.236978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.237685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.237976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.238290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.239027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.240681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.251557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1215/2438] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:30.261233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.272590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d4d7-d9c9-4e3f-811b-5cc800422ff6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.277080 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-07e921df-15cf-4533-9818-bb080dae96cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d409311f7f435cb6949088e6ec1697'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:30.278559 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.279239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.282080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.282080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.282080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.282425 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.297725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1224/2439] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:29 2022] DELETE /identity/v3/users/48d409311f7f435cb6949088e6ec1697 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:30.299071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1216/2440] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:30.300037 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.300640 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.301036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.301423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.310757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e300f7-f8b5-4a13-8258-2603df2566da admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.320553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:30.326793 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:30.328908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.380405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.381411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.381760 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.382106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] PATH_INFO: `/v3/projects/812a9c20ecd64a659494cc19ab7040f1/users/ca2b87b09c654108bb4039e014010378/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.397930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=812a9c20ecd64a659494cc19ab7040f1, user_id=ca2b87b09c654108bb4039e014010378, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.400565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997d62-2b48-4ca6-b167-9bd2830d8cee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.412344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1225/2441] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:30.413360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.414661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.447050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:30.474385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814ae6-24d4-48ca-99ed-729006a0aef8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.478084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.478769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.479062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.479344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.481318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.493583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.497825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.505214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1226/2442] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:30.505995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.515400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130095-c530-4d2b-bfc6-7ee174ab87a6 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.524847 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.525520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.525810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.526117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.545427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.545427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.546620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1217/2443] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:30 2022] PUT /identity/v3/projects/812a9c20ecd64a659494cc19ab7040f1/users/ca2b87b09c654108bb4039e014010378/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:30.548308 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.548861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.549331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.552627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1227/2444] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:30.577595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] MFA Rules not processed for user `ca2b87b09c654108bb4039e014010378`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:30.578923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.652549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1218/2445] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:30.663525 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:30.665161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:30.728660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e0a9-854f-4ec1-95df-12943a4ae83a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:30.781108 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:30.781772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:30.782058 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:30.782398 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:30.791930 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:30.794028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:30.804844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1228/2446] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:31.154304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:31.156045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:31.255354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e629a1-f7d8-4f88-aa1d-9d631203c198 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:31.260890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:31.261863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:31.263772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:31.263772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] PATH_INFO: `/v3/projects/3b1e7edea4744b77a7777b04cf2ee459` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:31.264935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1e7edea4744b77a7777b04cf2ee459)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:31.267573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:31.566585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:31.584012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1e7edea4744b77a7777b04cf2ee459', 'request_id': 'req-73636a3c-9377-4b47-bd18-089912c33381'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:31.719729 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1e7edea4744b77a7777b04cf2ee459', 'request_id': 'req-73636a3c-9377-4b47-bd18-089912c33381'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:31.727461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1e7edea4744b77a7777b04cf2ee459', 'request_id': 'req-73636a3c-9377-4b47-bd18-089912c33381'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:31.743461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] The token cache is being invalidate because project 3b1e7edea4744b77a7777b04cf2ee459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:31.743804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:31.744860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:31.749459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1219/2447] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:31 2022] DELETE /identity/v3/projects/3b1e7edea4744b77a7777b04cf2ee459 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:31.753671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:31.774506 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9a87-a024-4894-bd6a-fc9ed0ac571d service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:31.838061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:31.838927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:31.839209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:31.839485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] PATH_INFO: `/v3/users/5632e6f82b604f0d807b76614db10cd5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:31.841333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5632e6f82b604f0d807b76614db10cd5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:31.843311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:31.864482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:32.126590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5632e6f82b604f0d807b76614db10cd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:32.127558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5632e6f82b604f0d807b76614db10cd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:32.128213 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5632e6f82b604f0d807b76614db10cd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:32.153409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5632e6f82b604f0d807b76614db10cd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:32.258307 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0421e405-67bd-4fb7-941e-8216513b624a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5632e6f82b604f0d807b76614db10cd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:32.273923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1229/2448] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:31 2022] DELETE /identity/v3/users/5632e6f82b604f0d807b76614db10cd5 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:33.069500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:33.075520 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:33.092872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73636a3c-9377-4b47-bd18-089912c33381 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:33.175893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:33.177086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.177386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.177671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] PATH_INFO: `/v3/projects/582af92228a242b8ad607b55b27d33c9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.179023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582af92228a242b8ad607b55b27d33c9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:33.180999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:33.421459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582af92228a242b8ad607b55b27d33c9', 'request_id': 'req-81f97382-1531-4bf2-a75a-27024bd14619'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:33.539816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582af92228a242b8ad607b55b27d33c9', 'request_id': 'req-81f97382-1531-4bf2-a75a-27024bd14619'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:33.547838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582af92228a242b8ad607b55b27d33c9', 'request_id': 'req-81f97382-1531-4bf2-a75a-27024bd14619'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:33.560064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] The token cache is being invalidate because project 582af92228a242b8ad607b55b27d33c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:33.560552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:33.561228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81f97382-1531-4bf2-a75a-27024bd14619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:33.562877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1220/2449] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:33 2022] DELETE /identity/v3/projects/582af92228a242b8ad607b55b27d33c9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:33.567822 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.568305 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.568401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.588496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:33.593463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:33.674574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1230/2450] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:33.682287 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.682580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.682858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.702077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:33.703325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:33.712332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1221/2451] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:33.717927 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:33.728290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db3895-7e84-4ae7-a42c-03d4fc0a3145 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:33.733710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:33.734404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.734691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.734970 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.735696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:33.736005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:33.738089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:33.752377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1231/2452] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:33.756891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:33.766741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e148-bb9e-4b40-ace8-9dc44a5d47c3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:33.771814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:33.772560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.772846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.773129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.773839 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:33.775821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:33.874229 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1222/2453] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:33 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:33.876090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:33.886698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc5293-77ec-4297-8d8d-65ecde634f82 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:33.953235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:33.953975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:33.954301 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:33.954584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:33.955300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:33.957239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.068997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1232/2454] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:33 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:34.078349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.089713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ecee8-a40e-4fdc-879e-fd55f31a2be4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.095567 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.096240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.096530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.096814 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.097575 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.099325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.111182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1223/2455] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:34.120885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.138505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6c73d-dbcc-4aba-8b6b-f5103ea153fb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.152254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.153590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.154168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.154477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.158046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.160159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4548fc-4d67-4b1a-a043-c5314ab7536d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.175248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1233/2456] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:34.183059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.203015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f777-b030-48b7-b017-d38098c937a9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.213276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.214612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.214901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.215994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] PATH_INFO: `/v3/projects/82ab70df3d9a45618599de9dcc7dc876/users/2bf5f4fa83884b92b2f153b76319bab9/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.219278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:34.234317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ab70df3d9a45618599de9dcc7dc876, user_id=2bf5f4fa83884b92b2f153b76319bab9, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.237998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.333676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1224/2457] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:34 2022] PUT /identity/v3/projects/82ab70df3d9a45618599de9dcc7dc876/users/2bf5f4fa83884b92b2f153b76319bab9/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:34.345950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.346119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.352247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.354245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:34.390110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] MFA Rules not processed for user `2bf5f4fa83884b92b2f153b76319bab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:34.391587 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:34.474121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1234/2458] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:34.478990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.562374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dee12-75c2-44ce-b66f-31437898a11f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.567319 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.567937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.568221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.568500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.569247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.571311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.716854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1225/2459] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:34 2022] POST /identity/v3/projects => generated 363 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:34.717196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.728351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be133d7-7e6d-4d43-8d46-b4b18bf3c074 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.789253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.790689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.791134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.794471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.794471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.795792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.795914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.797846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:34.876226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a56d2-4cc6-43bc-a273-aaa8d8ef609b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.881800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.882500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.882792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.883076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.884878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:34.896759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.898439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.911579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1235/2460] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:34 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:34.911754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1226/2461] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:34.911853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.920998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f7217-6d74-4fcc-832f-2918e53af263 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.925926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.926720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.927097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.927445 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.928626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.929904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:34.957306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1236/2462] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:34.958135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.967193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:34.969405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:34.985108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378ad3-1087-48dd-bf06-96fd356051e6 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.985108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.985108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.985108 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.985618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] PATH_INFO: `/v3/projects/eea58efb8c7548bab52c20f3c3feece1/users/eba693aa5018434aba635e3fd34a16e6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.988256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653fca5-1ed7-4817-8cfd-29cf4fd29b1a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:34.993627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:34.994572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:34.994867 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:34.995199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] PATH_INFO: `/v3/users/80053b21eaa04a919d2bf6723018fcfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:34.997112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80053b21eaa04a919d2bf6723018fcfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:34.999204 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.002382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea58efb8c7548bab52c20f3c3feece1, user_id=eba693aa5018434aba635e3fd34a16e6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.005207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.106404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1227/2463] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:34 2022] PUT /identity/v3/projects/eea58efb8c7548bab52c20f3c3feece1/users/eba693aa5018434aba635e3fd34a16e6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:35.110320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:35.145937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:35.174244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db14fa-0e26-434d-880c-f0125233f62a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:35.185501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:35.185501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.185501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.185501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.185942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.185942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.194614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1228/2464] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:35.198675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:35.208952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f074d-49f6-4db1-a3a4-2039e0fc910a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:35.214250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:35.215577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.215891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.219896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] PATH_INFO: `/v3/projects/eea58efb8c7548bab52c20f3c3feece1/users/eba693aa5018434aba635e3fd34a16e6/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.219896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea58efb8c7548bab52c20f3c3feece1, user_id=eba693aa5018434aba635e3fd34a16e6, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.221049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e11a6-b8ed-4261-9628-67ba6ef77baa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.223562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80053b21eaa04a919d2bf6723018fcfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.224626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80053b21eaa04a919d2bf6723018fcfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.225271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80053b21eaa04a919d2bf6723018fcfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.234860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1229/2465] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:35 2022] PUT /identity/v3/projects/eea58efb8c7548bab52c20f3c3feece1/users/eba693aa5018434aba635e3fd34a16e6/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:35.239691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80053b21eaa04a919d2bf6723018fcfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.245106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358563-7290-4acc-8936-b8d95070569a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.245398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358563-7290-4acc-8936-b8d95070569a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.245683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358563-7290-4acc-8936-b8d95070569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.272405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5f358563-7290-4acc-8936-b8d95070569a None None] MFA Rules not processed for user `eba693aa5018434aba635e3fd34a16e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:35.273627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5f358563-7290-4acc-8936-b8d95070569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:35.311324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:35.339427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80053b21eaa04a919d2bf6723018fcfe'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.344318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1230/2466] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:35.354594 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1237/2467] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:34 2022] DELETE /identity/v3/users/80053b21eaa04a919d2bf6723018fcfe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:35.359484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358563-7290-4acc-8936-b8d95070569a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:35.361141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5f358563-7290-4acc-8936-b8d95070569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:35.420348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358563-7290-4acc-8936-b8d95070569a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:35.474432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:35.475094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.475380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.475660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.536703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.538211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.548508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1231/2468] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:35.680883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:35.680883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:35.748315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdf21-a131-42e1-bb07-e7bae38dedd3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:35.753392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:35.754394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.754677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.754981 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] PATH_INFO: `/v3/projects/59581f23932f44ecba893023f88486d7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.756218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59581f23932f44ecba893023f88486d7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.758273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.861978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:35.870859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0854e-50e2-4cd4-96f2-38240736a1f4 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:35.882124 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59581f23932f44ecba893023f88486d7', 'request_id': 'req-14ceb056-7de2-4cb7-9296-cec024af1d21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.889423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:35.921471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:35.922044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.922373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.922657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.924437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:35.939574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59581f23932f44ecba893023f88486d7', 'request_id': 'req-14ceb056-7de2-4cb7-9296-cec024af1d21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.946279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59581f23932f44ecba893023f88486d7', 'request_id': 'req-14ceb056-7de2-4cb7-9296-cec024af1d21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.959401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] The token cache is being invalidate because project 59581f23932f44ecba893023f88486d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:35.959694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.960360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14ceb056-7de2-4cb7-9296-cec024af1d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:35.962029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1238/2469] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:35 2022] DELETE /identity/v3/projects/59581f23932f44ecba893023f88486d7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:35.967335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:35.967628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:35.967907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:35.982877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:35.984315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724cfb-7867-497f-a791-5464464a04f5 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:35.987003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:35.988250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:35.995102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1232/2470] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:36.055418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1239/2471] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:36.064085 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.070040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.070040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.084374 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:36.085717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:36.094513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1233/2472] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:36.098752 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.110838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2b4d-8a23-467f-9a1e-5df9ad4d6f08 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.115867 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.116572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.116860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.117137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.117871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:36.118185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.119838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.132868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1240/2473] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:36.137581 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.154904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ed58a-4362-42d8-aee0-030f2b97a52e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.154904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.155571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.155888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.156168 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.156872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.158850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.180365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:36.295202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1234/2474] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:36 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:36.299707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.310142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d2bf-fecc-44d1-a8ab-207933d9e2c6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.365566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.366265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.366582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.366866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.367584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.369558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.566963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1241/2475] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:36 2022] POST /identity/v3/users => generated 303 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:36.569332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.585629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a3339-b686-4e66-a5ca-685cc5912919 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.601321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.603619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.603619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.603619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.603619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.605180 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.617870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1235/2476] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:36.624409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.635680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeae4a8-f815-48cd-bdab-13fb3fe5bc25 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.641324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.641986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.642324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.642606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.643339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.645067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb97b-1b02-46df-8985-1bca7c1c51a7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.656622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1242/2477] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:36.660977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.671690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0e12f-f557-4e21-a5be-8c6b78523a1a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.676446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.677441 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.677730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.678017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] PATH_INFO: `/v3/projects/960db89746ad41c0bd8d7b4d6ddd42f5/users/86e16ac392724011a7f189f7bcadbb2e/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.694145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] RBAC: Authorizing `identity:create_grant(project_id=960db89746ad41c0bd8d7b4d6ddd42f5, user_id=86e16ac392724011a7f189f7bcadbb2e, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.696907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.790487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:36.796398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1236/2478] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:36 2022] PUT /identity/v3/projects/960db89746ad41c0bd8d7b4d6ddd42f5/users/86e16ac392724011a7f189f7bcadbb2e/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:36.801513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac45f-fecb-45a3-9098-4cd9ea17c271 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.801991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac45f-fecb-45a3-9098-4cd9ea17c271 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.802106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac45f-fecb-45a3-9098-4cd9ea17c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.821400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-44aac45f-fecb-45a3-9098-4cd9ea17c271 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:36.822585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-44aac45f-fecb-45a3-9098-4cd9ea17c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:36.882586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1243/2479] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:36.893156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:36.894937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:36.954555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b6e2-ae22-49e3-8d46-3bc6615e119d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:36.959338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:36.960000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:36.960291 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:36.960638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:36.970091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:36.971590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:36.981702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1237/2480] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:38.232706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.232706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.233170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.263181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] MFA Rules not processed for user `86e16ac392724011a7f189f7bcadbb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:38.264621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:38.346287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1244/2481] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:38.350458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.361152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd333-d607-4c85-80f4-00b9ad5ea7d0 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.365805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.366534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.366826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.367109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.367800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.369765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:38.501706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1238/2482] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:38 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:38.506339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.517502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5938-d522-460e-97c3-55fb49d4003b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.521999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:38.575088 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.575818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.576106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.576387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.577075 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.579036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:38.723726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1245/2483] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:38 2022] POST /identity/v3/users => generated 309 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:38.731189 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.741714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f422d-7b04-4b6d-b994-aba1c5942b7d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.746681 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.747369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.747661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.748093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.748907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.750558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:38.762891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1239/2484] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:38.767225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.778830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b509-8744-4a63-b5b4-edd3e2816cee admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.785641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.786150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.786489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.786781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] PATH_INFO: `/v3/projects/42e1acb7897340b2a8684dc635dad5fa/users/2f3bd11644114a41a5910352dbc231de/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.805918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e1acb7897340b2a8684dc635dad5fa, user_id=2f3bd11644114a41a5910352dbc231de, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.809149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:38.882328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1246/2485] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:38 2022] PUT /identity/v3/projects/42e1acb7897340b2a8684dc635dad5fa/users/2f3bd11644114a41a5910352dbc231de/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:38.886381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.898647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949c32-c294-4ac3-ba96-599cf42820db admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.955369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.956039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.956324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.956600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.957324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.958973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:38.969539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1240/2486] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:38.973774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:38.984121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3db98-141f-4320-bcd9-5dad3f093136 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:38.988782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:38.989740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:38.990035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:38.990356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] PATH_INFO: `/v3/projects/42e1acb7897340b2a8684dc635dad5fa/users/2f3bd11644114a41a5910352dbc231de/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:38.992345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e1acb7897340b2a8684dc635dad5fa, user_id=2f3bd11644114a41a5910352dbc231de, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:38.995055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d62f8-b985-4d89-acb1-ba7c1b5a3ac8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:39.006304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1247/2487] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:38 2022] PUT /identity/v3/projects/42e1acb7897340b2a8684dc635dad5fa/users/2f3bd11644114a41a5910352dbc231de/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:39.719880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:39.722340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:39.735758 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf50ea-5b42-429c-b18e-c6d17bb15779 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:39.792748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:39.794221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:39.794536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:39.794827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] PATH_INFO: `/v3/users/2bf5f4fa83884b92b2f153b76319bab9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:39.796049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf5f4fa83884b92b2f153b76319bab9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:39.798040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:39.803069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:40.004863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf5f4fa83884b92b2f153b76319bab9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:40.005476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf5f4fa83884b92b2f153b76319bab9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:40.116973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf5f4fa83884b92b2f153b76319bab9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:40.124550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf5f4fa83884b92b2f153b76319bab9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:40.125195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf5f4fa83884b92b2f153b76319bab9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:40.142988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1241/2488] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:39 2022] DELETE /identity/v3/users/2bf5f4fa83884b92b2f153b76319bab9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:40.147709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a84fb-d122-4cce-8ea0-954bba9d3c6d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:40.149370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a84fb-d122-4cce-8ea0-954bba9d3c6d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:40.149370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a84fb-d122-4cce-8ea0-954bba9d3c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:40.166628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4a8a84fb-d122-4cce-8ea0-954bba9d3c6d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:40.167884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4a8a84fb-d122-4cce-8ea0-954bba9d3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:40.232952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1248/2489] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:40.242931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:40.244356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:40.310711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab65f3-4d17-45ad-b653-27a6d8b4b5c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:40.314573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:40.315302 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:40.315592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:40.315898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:40.326822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:40.328282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:40.338351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1242/2490] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:40.422148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:40.422520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:40.422932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:40.458617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] MFA Rules not processed for user `2f3bd11644114a41a5910352dbc231de`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:40.460303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:40.514796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:40.544994 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1249/2491] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:40.815606 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:40.818644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:40.834560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15e59-c358-4bf4-85af-b3cd72c19ff6 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:40.840254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:40.842278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:40.847444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:40.847444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] PATH_INFO: `/v3/projects/82ab70df3d9a45618599de9dcc7dc876` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:40.847444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ab70df3d9a45618599de9dcc7dc876)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:40.847444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:41.044942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ab70df3d9a45618599de9dcc7dc876', 'request_id': 'req-996ea628-8c7c-4828-9055-c71d1612568d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.133937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ab70df3d9a45618599de9dcc7dc876', 'request_id': 'req-996ea628-8c7c-4828-9055-c71d1612568d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.142477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ab70df3d9a45618599de9dcc7dc876', 'request_id': 'req-996ea628-8c7c-4828-9055-c71d1612568d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.154822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] The token cache is being invalidate because project 82ab70df3d9a45618599de9dcc7dc876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:41.155218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.155898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.157477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1243/2492] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:40 2022] DELETE /identity/v3/projects/82ab70df3d9a45618599de9dcc7dc876 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:41.161758 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:41.172945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f73555-aaf0-49af-93ea-1d7a294e7f94 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:41.240403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:41.241346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:41.241792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:41.242082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] PATH_INFO: `/v3/users/eba693aa5018434aba635e3fd34a16e6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:41.243375 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba693aa5018434aba635e3fd34a16e6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:41.245374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:41.439740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba693aa5018434aba635e3fd34a16e6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.440393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba693aa5018434aba635e3fd34a16e6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.440999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba693aa5018434aba635e3fd34a16e6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.453421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba693aa5018434aba635e3fd34a16e6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.561481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba693aa5018434aba635e3fd34a16e6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:41.576323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1250/2493] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:41 2022] DELETE /identity/v3/users/eba693aa5018434aba635e3fd34a16e6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:42.027663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.027663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:42.058061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ea628-8c7c-4828-9055-c71d1612568d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.063468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:42.115711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.116585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.116872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.117154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] PATH_INFO: `/v3/projects/eea58efb8c7548bab52c20f3c3feece1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.118391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea58efb8c7548bab52c20f3c3feece1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.120324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.144208 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.151135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:42.167675 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc72ba-8ccd-4bb5-b50e-c62e6ef7c343 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.174435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.175529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.175818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.176098 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] PATH_INFO: `/v3/users/86e16ac392724011a7f189f7bcadbb2e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.177374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e16ac392724011a7f189f7bcadbb2e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.179404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.241686 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea58efb8c7548bab52c20f3c3feece1', 'request_id': 'req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.327333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea58efb8c7548bab52c20f3c3feece1', 'request_id': 'req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.334592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea58efb8c7548bab52c20f3c3feece1', 'request_id': 'req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.345535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] The token cache is being invalidate because project eea58efb8c7548bab52c20f3c3feece1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:42.345853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.346529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81e50f9f-4ff2-4d85-bc5f-3490fcc962cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.348159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1244/2494] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:42 2022] DELETE /identity/v3/projects/eea58efb8c7548bab52c20f3c3feece1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:42.353207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923792-2d17-4d5a-9037-33193cb5cacf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.354070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923792-2d17-4d5a-9037-33193cb5cacf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.354380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923792-2d17-4d5a-9037-33193cb5cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.372703 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-81923792-2d17-4d5a-9037-33193cb5cacf None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:42.373852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-81923792-2d17-4d5a-9037-33193cb5cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:42.398436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e16ac392724011a7f189f7bcadbb2e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.399182 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e16ac392724011a7f189f7bcadbb2e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.399813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e16ac392724011a7f189f7bcadbb2e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.411889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:42.413965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e16ac392724011a7f189f7bcadbb2e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.438070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1245/2495] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:42.446006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.446328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.446607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.466679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:42.467905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:42.476167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1246/2496] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:42.480345 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.489619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02344de8-9d32-4aa4-a5c3-0248c5ad0ef9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.494539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.495188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.495474 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.495762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.496513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:42.496824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.498733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.510868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1247/2497] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:37:42.515823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.526113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbcb18-177a-44db-a55f-d1efd1d1d167 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.528456 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e16ac392724011a7f189f7bcadbb2e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.532831 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.533486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.533779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.534060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.534852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.537822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.542261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1251/2498] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:42 2022] DELETE /identity/v3/users/86e16ac392724011a7f189f7bcadbb2e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:42.667258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1248/2499] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:42 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:42.671486 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.742229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14ab1-a27a-4d49-8b68-54f9aa0dbaed admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.802060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.802781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.803066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.803346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.804047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.805988 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.808368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.811077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:42.831341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329eb2-3d4e-4d78-9412-adee8ea23f64 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.844822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.844822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.844822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.844822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] PATH_INFO: `/v3/projects/960db89746ad41c0bd8d7b4d6ddd42f5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.845584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=960db89746ad41c0bd8d7b4d6ddd42f5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.845584 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.901476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1252/2500] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:42 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:42.902836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.913253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490846-2b3b-40d2-927f-af28fad07ee8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.919384 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.920158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.920813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.921109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.921891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.923588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.935011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1253/2501] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:42.938919 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.948622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60245d9-557a-48b1-abae-768dab3499f1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:42.953277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:42.953917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:42.954225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:42.954536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:42.955264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:42.957002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:42.969778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1254/2502] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:42.973908 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:42.977375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960db89746ad41c0bd8d7b4d6ddd42f5', 'request_id': 'req-5f1edadf-a3e1-4c73-80fb-06e5544461cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:42.986932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bc-d121-4217-a5c7-60bd1419b656 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.045245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.046134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.046460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.046736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] PATH_INFO: `/v3/projects/0d819e89815b49d5b891df33b770d38b/users/1553839f0e2949d68c7a38266f5a6606/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.062279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d819e89815b49d5b891df33b770d38b, user_id=1553839f0e2949d68c7a38266f5a6606, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.065040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11114054-e29c-4e5d-93f1-fc64cff49a1b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.076841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960db89746ad41c0bd8d7b4d6ddd42f5', 'request_id': 'req-5f1edadf-a3e1-4c73-80fb-06e5544461cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.083871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960db89746ad41c0bd8d7b4d6ddd42f5', 'request_id': 'req-5f1edadf-a3e1-4c73-80fb-06e5544461cf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.094812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] The token cache is being invalidate because project 960db89746ad41c0bd8d7b4d6ddd42f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:43.095101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.096026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.097600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1249/2503] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:42 2022] DELETE /identity/v3/projects/960db89746ad41c0bd8d7b4d6ddd42f5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:43.101312 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.102970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:43.116218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1edadf-a3e1-4c73-80fb-06e5544461cf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.121280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.125506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.125506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.125506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] PATH_INFO: `/v3/users/2f3bd11644114a41a5910352dbc231de` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.125506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3bd11644114a41a5910352dbc231de)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.129091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.129174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1255/2504] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:42 2022] PUT /identity/v3/projects/0d819e89815b49d5b891df33b770d38b/users/1553839f0e2949d68c7a38266f5a6606/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:43.140579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.140872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.141181 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.173041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] MFA Rules not processed for user `1553839f0e2949d68c7a38266f5a6606`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:43.173041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:43.236199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1256/2505] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:43.240738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.242146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:43.307053 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbd5e6-5244-4590-8b28-6d57b458ede5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.312387 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.313048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.313334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.313610 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.314331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.316302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.370190 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3bd11644114a41a5910352dbc231de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.370858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3bd11644114a41a5910352dbc231de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.471844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1257/2506] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:43 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:43.475933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.479835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:43.484209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:43.484919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3bd11644114a41a5910352dbc231de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.492957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3bd11644114a41a5910352dbc231de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.493676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3bd11644114a41a5910352dbc231de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.511443 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1250/2507] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:43 2022] DELETE /identity/v3/users/2f3bd11644114a41a5910352dbc231de => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:43.542680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac6c4-bb7c-44f7-9a66-b9a9573e1026 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.600855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.601541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.601832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.602119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.602856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.605123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.689886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1258/2508] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:43 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:43.691144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.701990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0456a-0a46-427e-8898-fc93b893e19c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.706783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.707532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.707858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.708141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.708869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.710522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.721220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1251/2509] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:43.725524 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.735615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7eb8-0008-4f4e-8b79-959debe480d9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.740214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.741082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.741367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.741698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] PATH_INFO: `/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc/users/5f46836ca8d841d793366c863f3882f8/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.756655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27d2da8f37348bd8e6fe3ae24370afc, user_id=5f46836ca8d841d793366c863f3882f8, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.759345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.774087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.776645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:43.790496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b67829-60aa-4650-824e-25009b9a0e65 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.796056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.796933 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.797224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.799808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] PATH_INFO: `/v3/projects/42e1acb7897340b2a8684dc635dad5fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.799808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e1acb7897340b2a8684dc635dad5fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.800917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.824214 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1259/2510] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:43 2022] PUT /identity/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc/users/5f46836ca8d841d793366c863f3882f8/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:43.828733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.893144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53bd6f-1ac0-40d2-8457-6f7e7a6d9750 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.897962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.898642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.898938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.899223 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.899962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.901572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:43.914128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1260/2511] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:43.917390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:43.928472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794e43-c728-4b7b-9e51-861df19ae901 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:43.928951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e1acb7897340b2a8684dc635dad5fa', 'request_id': 'req-2e7733ac-6e97-460d-83be-b9f787c45f86'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:43.989633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:43.990621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:43.990718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:43.990992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] PATH_INFO: `/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc/users/5f46836ca8d841d793366c863f3882f8/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:43.993025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27d2da8f37348bd8e6fe3ae24370afc, user_id=5f46836ca8d841d793366c863f3882f8, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:43.995776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73465-218e-490f-9718-d94968e28544 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.002943 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e1acb7897340b2a8684dc635dad5fa', 'request_id': 'req-2e7733ac-6e97-460d-83be-b9f787c45f86'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.016086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1261/2512] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:43 2022] PUT /identity/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc/users/5f46836ca8d841d793366c863f3882f8/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:44.016299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e1acb7897340b2a8684dc635dad5fa', 'request_id': 'req-2e7733ac-6e97-460d-83be-b9f787c45f86'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.019031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.019453 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.019794 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.022488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] The token cache is being invalidate because project 42e1acb7897340b2a8684dc635dad5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:44.022793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.023463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e7733ac-6e97-460d-83be-b9f787c45f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.025129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1252/2513] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:43 2022] DELETE /identity/v3/projects/42e1acb7897340b2a8684dc635dad5fa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:44.032615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e89e5-4fd0-4473-baf5-d0c6fe6fccc3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.032962 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e89e5-4fd0-4473-baf5-d0c6fe6fccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.033354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e89e5-4fd0-4473-baf5-d0c6fe6fccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.048868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:44.050118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] MFA Rules not processed for user `5f46836ca8d841d793366c863f3882f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:44.051325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-092e89e5-4fd0-4473-baf5-d0c6fe6fccc3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:44.051447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.052725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-092e89e5-4fd0-4473-baf5-d0c6fe6fccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.122332 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1262/2514] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:44.125840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1253/2515] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:44.134530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.135236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.135534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.135826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.135990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.155650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:44.156875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.165376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1254/2516] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:44.175731 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.185910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044b45-4987-4f9e-be2a-f7e828bd62bb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.191368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.192036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.192321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.192610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.193986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:44.193986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.195369 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.197999 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506c0a-6383-404f-bde1-fe7b756e470a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.202343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.203130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.203339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.203622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.208318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1255/2517] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:44.213013 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.215883 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.217385 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.223186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46f55-e1b9-4689-b8a0-fd9ee0059454 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.228381 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1263/2518] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:44.231957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.232683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.232968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.233241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.233929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.236034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.287224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:44.305193 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.306725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.321316 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b13f65-3537-447c-ab71-6246abeab7b0 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.326614 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.327484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.327766 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.328042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] PATH_INFO: `/v3/users/1553839f0e2949d68c7a38266f5a6606` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.329245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1553839f0e2949d68c7a38266f5a6606)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.331180 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.351647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1256/2519] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:44.355834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.417499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425846d-0416-4ae3-aecf-e58662984aa0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.422988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.423661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.423948 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.424226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.424913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.426888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.550310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1257/2520] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/users => generated 278 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:44.554523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.564918 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbe2fe-1c18-4ddb-a954-71c173f6d008 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.568842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:44.570874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.570874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.570874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.570874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.571627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.573243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.583324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1258/2521] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:44.584418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1553839f0e2949d68c7a38266f5a6606'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.585096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1553839f0e2949d68c7a38266f5a6606'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.585740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1553839f0e2949d68c7a38266f5a6606'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.587333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.589009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.598367 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1553839f0e2949d68c7a38266f5a6606'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.601888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291865e-8d87-4961-81c5-739ebf284a7b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.607264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.608063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.608468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.608773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.609490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.611137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.622741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1259/2522] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:44.629341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.639288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028b8-d790-445f-a7b4-ed23d763e91d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.644061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.644947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.645232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.645512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] PATH_INFO: `/v3/projects/8f150388aec84f31a270940f2369362e/users/cf2343af66234c6db649662273fb31be/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.660621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f150388aec84f31a270940f2369362e, user_id=cf2343af66234c6db649662273fb31be, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.663375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf15b-a411-45e9-bcba-81ddcc32e6e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.692750 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c3ded257-72ee-435f-a612-a64f7e27046e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1553839f0e2949d68c7a38266f5a6606'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:44.706824 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1264/2523] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:44 2022] DELETE /identity/v3/users/1553839f0e2949d68c7a38266f5a6606 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:44.711439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.711734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.712052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.729183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:44.730399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.750040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1260/2524] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:44 2022] PUT /identity/v3/projects/8f150388aec84f31a270940f2369362e/users/cf2343af66234c6db649662273fb31be/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:44.760802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.761096 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.761381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.775459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:44.791277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] MFA Rules not processed for user `cf2343af66234c6db649662273fb31be`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:44.792487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.796665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1265/2525] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:44.807113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.808489 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:44.838773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:44.861625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1261/2526] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:44.866887 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:44.872226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d217-6572-4d2f-bb40-9d8f20aafefa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.921032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.921679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.921961 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.922263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.929977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b2887-7576-4529-b0dd-fab4dc1922f6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:44.931246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.932714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.935245 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:44.935925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:44.936211 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:44.936495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:44.937186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:44.939271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:44.942896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1266/2527] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:45.067585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1262/2528] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:44 2022] POST /identity/v3/projects => generated 355 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:45.071943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.078827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:45.084989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881006-32b2-4235-9f4d-196e4ca603b8 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.149559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.150271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.150570 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.150852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.151561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.154112 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.236265 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1267/2529] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:45 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:45.240585 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.251657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813871da-3b31-42a5-a836-46c66feb3428 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.257633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.262523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.262523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.262523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.262523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.262523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.273988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1263/2530] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:45.278788 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.288938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a288-3620-4a2a-8ec8-e2893e8756b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.293971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.294916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.295196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.295469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] PATH_INFO: `/v3/projects/87449f8893ef49bf95ba3f1457c45ca6/users/2df70841edd24e829d45aaea3e293366/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.310844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87449f8893ef49bf95ba3f1457c45ca6, user_id=2df70841edd24e829d45aaea3e293366, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.314472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.369789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.371765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:45.393452 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fbbd-5006-46f1-a179-ff0f5a4fd2e6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.393839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1268/2531] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:45 2022] PUT /identity/v3/projects/87449f8893ef49bf95ba3f1457c45ca6/users/2df70841edd24e829d45aaea3e293366/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:45.397611 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.443684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:45.444298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:45.475260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.476141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.476426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.476702 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] PATH_INFO: `/v3/projects/0d819e89815b49d5b891df33b770d38b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.477670 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6bde1-5c4c-449e-b33e-395c57a89b91 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.477901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d819e89815b49d5b891df33b770d38b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.480006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.483048 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.483746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.484015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.484303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.485071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.486827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.497438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1269/2532] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:45.501551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.511493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ec26-60f9-42eb-a284-49f62af4d7b3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.517009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.517880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.520142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.520142 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] PATH_INFO: `/v3/projects/87449f8893ef49bf95ba3f1457c45ca6/users/2df70841edd24e829d45aaea3e293366/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.520459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=87449f8893ef49bf95ba3f1457c45ca6, user_id=2df70841edd24e829d45aaea3e293366, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.523278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8bde-5f8b-49e7-a70e-042a99259ada admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.534426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1270/2533] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:45 2022] PUT /identity/v3/projects/87449f8893ef49bf95ba3f1457c45ca6/users/2df70841edd24e829d45aaea3e293366/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:45.544618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.544911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.545233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.571713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] MFA Rules not processed for user `2df70841edd24e829d45aaea3e293366`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:45.572857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:45.601358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d819e89815b49d5b891df33b770d38b', 'request_id': 'req-79de1c8d-4203-4fd3-88a9-bbc2566fb445'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:45.644903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1271/2534] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:45.657576 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.663717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:45.693502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:45.693662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d819e89815b49d5b891df33b770d38b', 'request_id': 'req-79de1c8d-4203-4fd3-88a9-bbc2566fb445'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:45.708203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d819e89815b49d5b891df33b770d38b', 'request_id': 'req-79de1c8d-4203-4fd3-88a9-bbc2566fb445'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:45.720528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] The token cache is being invalidate because project 0d819e89815b49d5b891df33b770d38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:45.720939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:45.721700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:45.723652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1264/2535] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:45 2022] DELETE /identity/v3/projects/0d819e89815b49d5b891df33b770d38b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:45.729535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:45.730983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0890-5cc7-49f3-b0c5-cb87e4566529 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.731122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:45.785013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.786914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.787087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.787356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.789273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:45.806267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de1c8d-4203-4fd3-88a9-bbc2566fb445 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:45.812512 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:45.813471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:45.813755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:45.814041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] PATH_INFO: `/v3/users/5f46836ca8d841d793366c863f3882f8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:45.815342 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f46836ca8d841d793366c863f3882f8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.817371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.856728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:45.858110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:45.868117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1272/2536] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:46.003848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f46836ca8d841d793366c863f3882f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.004531 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f46836ca8d841d793366c863f3882f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.069481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f46836ca8d841d793366c863f3882f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.079328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f46836ca8d841d793366c863f3882f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.080044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f46836ca8d841d793366c863f3882f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.081321 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:46.089632 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:46.091167 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:46.099155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1265/2537] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:45 2022] DELETE /identity/v3/users/5f46836ca8d841d793366c863f3882f8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:46.102392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59009183-9a8e-42af-88b4-481f3bccafb6 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:46.157231 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:46.165175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:46.165175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:46.165175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:46.165175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:46.213474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:46.228405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:46.230187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:46.240866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1273/2538] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:46.575884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:46.577592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:46.657906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1cc3-a06a-4642-a870-73afe7e56226 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:46.662624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:46.663487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:46.663774 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:46.664056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] PATH_INFO: `/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:46.665292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27d2da8f37348bd8e6fe3ae24370afc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:46.667269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:46.821724 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27d2da8f37348bd8e6fe3ae24370afc', 'request_id': 'req-c8d71060-e685-47af-bc6c-d4c8f06284f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.888488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:46.889971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:46.904718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27d2da8f37348bd8e6fe3ae24370afc', 'request_id': 'req-c8d71060-e685-47af-bc6c-d4c8f06284f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.906937 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4338-56c6-4af6-8794-1e4aed395603 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:46.912336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27d2da8f37348bd8e6fe3ae24370afc', 'request_id': 'req-c8d71060-e685-47af-bc6c-d4c8f06284f8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.923117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] The token cache is being invalidate because project f27d2da8f37348bd8e6fe3ae24370afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:46.923497 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.924105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c8d71060-e685-47af-bc6c-d4c8f06284f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:46.925689 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1266/2539] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:46 2022] DELETE /identity/v3/projects/f27d2da8f37348bd8e6fe3ae24370afc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:46.930412 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302705d-c44c-4ebc-8ff4-622c77404d57 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:46.930706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302705d-c44c-4ebc-8ff4-622c77404d57 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:46.931117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302705d-c44c-4ebc-8ff4-622c77404d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:46.949324 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3302705d-c44c-4ebc-8ff4-622c77404d57 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:46.951136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3302705d-c44c-4ebc-8ff4-622c77404d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:46.969376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:46.970291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:46.970581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:46.970869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] PATH_INFO: `/v3/users/ca2b87b09c654108bb4039e014010378` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:46.972117 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2b87b09c654108bb4039e014010378)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:46.974103 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.011353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1267/2540] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:47.020837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.021133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.021420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.040135 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:47.046586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.049528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1268/2541] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:47.053600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.059612 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:47.063238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1950f0-c13c-4254-bc6f-9dfcacd3d37c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.068066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.068709 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.068999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.069278 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.070120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:47.070471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.072203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.085391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1269/2542] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:37:47.089990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.100155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ceaa-1416-4be7-a8d4-98fd88be56c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.104865 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.105515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.105800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.106080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.106830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.108778 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.194674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2b87b09c654108bb4039e014010378'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:47.195273 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2b87b09c654108bb4039e014010378'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:47.195893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2b87b09c654108bb4039e014010378'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:47.213083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1270/2543] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:47.214503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2b87b09c654108bb4039e014010378'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:47.214630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.216249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.279530 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff470-2455-4a3d-a109-1ea42cc516e9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.284410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.285138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.285438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.285952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.287193 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.289184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.297558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9458565-970a-4489-b0f9-054c0bc6fac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2b87b09c654108bb4039e014010378'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:47.311526 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1274/2544] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:46 2022] DELETE /identity/v3/users/ca2b87b09c654108bb4039e014010378 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:47.315993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.316333 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.316625 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.333717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:47.335070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.380511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1271/2545] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:47.385143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.396179 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5071e2-9013-4d42-852a-36c8836c8f89 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.399723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1275/2546] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:47.404311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.405002 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.405288 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.405999 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.406868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.407052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.408070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.408438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.419279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:47.421513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1272/2547] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:47.425177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.435750 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4346ec-de58-427d-a639-b461ea5a6c70 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.440436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.441090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.441379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.441657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.442420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.444055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.457093 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1273/2548] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:47.459484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.469200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9c6e8-09b7-4664-a18a-a5add932a161 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.469662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e96846-b6dd-4ef0-8a07-1e7cc94afeed None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.473496 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.474031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.474184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.474467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.474749 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.475181 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.475460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.475950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] PATH_INFO: `/v3/projects/114a02984da74a7a8bb59c365f443d78/users/e4bcc9be3c6449dcaa0b8c5c5fa3843c/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.484868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.486547 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b6e0-88a3-4b85-b4c4-98ce56da4bf1 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.491906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114a02984da74a7a8bb59c365f443d78, user_id=e4bcc9be3c6449dcaa0b8c5c5fa3843c, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.494594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.497162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1276/2549] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:47.561883 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1274/2550] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:47 2022] PUT /identity/v3/projects/114a02984da74a7a8bb59c365f443d78/users/e4bcc9be3c6449dcaa0b8c5c5fa3843c/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:47.572403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.572898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.573205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.600984 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] MFA Rules not processed for user `e4bcc9be3c6449dcaa0b8c5c5fa3843c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:47.602239 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.667659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1277/2551] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:47.672897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.742113 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc017a2-a261-44af-bf45-044ae01ff4f2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.747591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.748263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.748552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.748838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.749532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.751508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.854890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:47.862785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1275/2552] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:47.866780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.879556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0576a-0024-4c00-9f9a-88cac36d0823 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.939176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.939841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.940128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.940405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.941090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:47.943121 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:47.976066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:47.977706 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:47.991665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157eaf-f727-4164-b6ff-7e5b8dfc00c0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:47.996491 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:47.997358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:47.997637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:47.997911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] PATH_INFO: `/v3/projects/812a9c20ecd64a659494cc19ab7040f1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:47.999207 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] RBAC: Authorizing `identity:delete_project(project_id=812a9c20ecd64a659494cc19ab7040f1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.001151 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.031566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1278/2553] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:47 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:48.035436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.045713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77778-b0c7-47b0-a7fa-120cde29ae6f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.050891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.051549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.051838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.052113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.052837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.054462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.065325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1279/2554] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:48.069360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.079205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8869f-474a-4ff7-a143-fe740410b227 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.086392 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812a9c20ecd64a659494cc19ab7040f1', 'request_id': 'req-5604a10e-d3bc-4112-b317-65f655f3832a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:48.091734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:48.134017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812a9c20ecd64a659494cc19ab7040f1', 'request_id': 'req-5604a10e-d3bc-4112-b317-65f655f3832a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:48.139215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.140130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.140563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.140791 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] PATH_INFO: `/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee/users/2687954566ce4dcb883b7929d95f6fc4/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.142318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812a9c20ecd64a659494cc19ab7040f1', 'request_id': 'req-5604a10e-d3bc-4112-b317-65f655f3832a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:48.157667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] The token cache is being invalidate because project 812a9c20ecd64a659494cc19ab7040f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:48.158186 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:48.159076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5604a10e-d3bc-4112-b317-65f655f3832a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:48.160362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb1dae696ff412e9816e1d3d9afe6ee, user_id=2687954566ce4dcb883b7929d95f6fc4, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.161290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1276/2555] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:47 2022] DELETE /identity/v3/projects/812a9c20ecd64a659494cc19ab7040f1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:48.167642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612992dc-1cb4-4847-a6f6-833424fcff15 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.167818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.167938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612992dc-1cb4-4847-a6f6-833424fcff15 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.168820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612992dc-1cb4-4847-a6f6-833424fcff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.189875 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-612992dc-1cb4-4847-a6f6-833424fcff15 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:48.191152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-612992dc-1cb4-4847-a6f6-833424fcff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.199227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1277/2556] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:48.207153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.207444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.207733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.226458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:48.227493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.236426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1278/2557] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:48.240315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.249888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0302-1420-4e47-b5b6-03b0e71806bf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.253738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1280/2558] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:48 2022] PUT /identity/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee/users/2687954566ce4dcb883b7929d95f6fc4/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:48.257723 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.259536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.310810 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.311472 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.311755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.312034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.312754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:48.313065 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.314707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.325165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b5ee-278a-4ad9-926c-882af9b3f424 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.327268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1279/2559] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:37:48.331001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.331521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.331757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.331954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.332233 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.332965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.334705 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.342128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186c18-0340-425e-9805-f7d1faf23221 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.349839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1281/2560] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:48.350012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.350012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.350012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.350012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.350421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.350840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.351565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.361372 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008408-04f5-411c-9ea5-2f855e64ac15 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.366130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.367043 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.367328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.367605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] PATH_INFO: `/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee/users/2687954566ce4dcb883b7929d95f6fc4/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.369692 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb1dae696ff412e9816e1d3d9afe6ee, user_id=2687954566ce4dcb883b7929d95f6fc4, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.372458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db7fe7-8682-4c27-ac25-a29a6c51c8b9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.383220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1282/2561] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:48 2022] PUT /identity/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee/users/2687954566ce4dcb883b7929d95f6fc4/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:48.393952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.394275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.394559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.420848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] MFA Rules not processed for user `2687954566ce4dcb883b7929d95f6fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:48.422051 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.468812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1280/2562] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:48.470138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.492403 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1283/2563] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:48.504209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.505617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.514370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:48.516674 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:48.534333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc8fc6-9576-419a-9798-cc2eecb82aa2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.539434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.545876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.545876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.545876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.545876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.545876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.565195 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764971cd-8eb5-46bb-a593-9248d8f3d23c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.612303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.612958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.613247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.613527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.627783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1281/2564] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:48.631548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.642891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74685cff-1c32-4a4a-a9d4-a274d11a38a2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.648522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.649395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.649850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.650146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.650912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.652579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.665916 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1282/2565] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:48.666966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.676906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9051-5b4f-452c-8e45-801256163a08 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.681785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.689518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.689518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.689518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.689823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.689919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.690026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.690126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956b62-8ab8-4e23-bd97-87363962feab admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.695498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1284/2566] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:48.696947 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1283/2567] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:48.701513 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.712126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02d6d-296f-4ec4-aec7-659b5108577d service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.716929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.717818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.718104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.718423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] PATH_INFO: `/v3/projects/965d4b70a5dd4ecc9ada262a21131ff0/users/1b7a64788ed14989a4a0a97f67adf97e/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.735652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965d4b70a5dd4ecc9ada262a21131ff0, user_id=1b7a64788ed14989a4a0a97f67adf97e, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.737390 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:48.812904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1285/2568] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:48 2022] PUT /identity/v3/projects/965d4b70a5dd4ecc9ada262a21131ff0/users/1b7a64788ed14989a4a0a97f67adf97e/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:48.823010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.823318 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.823628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.858800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] MFA Rules not processed for user `1b7a64788ed14989a4a0a97f67adf97e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:48.858800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.866308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.922424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1284/2569] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:48.927427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39500dc-e829-4dce-b3b3-76be8a2d7462 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:48.931211 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:48.931868 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:48.932151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:48.932431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:48.934591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:48.935078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.936084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:48.940140 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:48.996891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:48.998661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:49.008946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1286/2570] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:49.014812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb146-c301-4127-b4e8-a3625bfe23e2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:49.019176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:49.019937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:49.020294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:49.020656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:49.029755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:49.031361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506eff-fcfb-4fc9-b3d2-53b0fa3c2b8d service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:49.041073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1285/2571] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:50.128493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:50.194811 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d62d-8560-41b4-98b6-f9ade3d11a44 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:50.200446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:50.201298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:50.201591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:50.209091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] PATH_INFO: `/v3/users/e4bcc9be3c6449dcaa0b8c5c5fa3843c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:50.209091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bcc9be3c6449dcaa0b8c5c5fa3843c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:50.209091 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:50.482642 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bcc9be3c6449dcaa0b8c5c5fa3843c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:50.483472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bcc9be3c6449dcaa0b8c5c5fa3843c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:50.484161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bcc9be3c6449dcaa0b8c5c5fa3843c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:50.499143 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bcc9be3c6449dcaa0b8c5c5fa3843c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:50.589345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bcc9be3c6449dcaa0b8c5c5fa3843c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:50.605402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1287/2572] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:50 2022] DELETE /identity/v3/users/e4bcc9be3c6449dcaa0b8c5c5fa3843c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:50.611205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:50.611844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:50.611844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:50.634418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:50.637202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:50.652428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:50.700629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1286/2573] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:50.711522 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:50.713157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:50.743439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:50.774314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25858201-396f-436f-afe6-5facf8fe4fe9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:50.778646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:50.779302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:50.779590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:50.779884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:50.789483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:50.790969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:50.801583 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1288/2574] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:37:51.302123 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:51.303939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:51.321560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf98e3-2d23-414c-a7ba-37561c69882b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:51.343484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:51.343484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:51.343484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:51.343484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] PATH_INFO: `/v3/projects/114a02984da74a7a8bb59c365f443d78` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:51.343988 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=114a02984da74a7a8bb59c365f443d78)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:51.344145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:51.449145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114a02984da74a7a8bb59c365f443d78', 'request_id': 'req-b342b662-2fef-41dc-a1c2-070b9a9f2cff'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:51.516978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114a02984da74a7a8bb59c365f443d78', 'request_id': 'req-b342b662-2fef-41dc-a1c2-070b9a9f2cff'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:51.527083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114a02984da74a7a8bb59c365f443d78', 'request_id': 'req-b342b662-2fef-41dc-a1c2-070b9a9f2cff'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:51.543094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] The token cache is being invalidate because project 114a02984da74a7a8bb59c365f443d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:51.543380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:51.544371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:51.546375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1287/2575] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:51 2022] DELETE /identity/v3/projects/114a02984da74a7a8bb59c365f443d78 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:51.551032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:51.561139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d987-22f2-419f-b2eb-373f6bc52bd4 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:51.636289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:51.637190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:51.637480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:51.637769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] PATH_INFO: `/v3/users/2687954566ce4dcb883b7929d95f6fc4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:51.639765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2687954566ce4dcb883b7929d95f6fc4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:51.641896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:52.092250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2687954566ce4dcb883b7929d95f6fc4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:52.093178 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2687954566ce4dcb883b7929d95f6fc4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:52.093891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2687954566ce4dcb883b7929d95f6fc4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:52.108913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2687954566ce4dcb883b7929d95f6fc4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:52.231062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f63ba637-8706-4d7e-b2fc-a5f14237305a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2687954566ce4dcb883b7929d95f6fc4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:52.245313 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1289/2576] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:51 2022] DELETE /identity/v3/users/2687954566ce4dcb883b7929d95f6fc4 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:52.706490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:52.708026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:52.722184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b662-2fef-41dc-a1c2-070b9a9f2cff admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:52.793478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:52.794408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:52.794694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:52.795019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] PATH_INFO: `/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:52.796341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb1dae696ff412e9816e1d3d9afe6ee)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:52.798372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:52.933780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:52.936655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb1dae696ff412e9816e1d3d9afe6ee', 'request_id': 'req-21b60b9d-5784-4c79-ae75-2a5cb357ad30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:53.037171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb1dae696ff412e9816e1d3d9afe6ee', 'request_id': 'req-21b60b9d-5784-4c79-ae75-2a5cb357ad30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:53.043964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb1dae696ff412e9816e1d3d9afe6ee', 'request_id': 'req-21b60b9d-5784-4c79-ae75-2a5cb357ad30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:53.055292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] The token cache is being invalidate because project cfb1dae696ff412e9816e1d3d9afe6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:53.072014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:53.072014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-21b60b9d-5784-4c79-ae75-2a5cb357ad30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:53.072014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1288/2577] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:52 2022] DELETE /identity/v3/projects/cfb1dae696ff412e9816e1d3d9afe6ee => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:53.072363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.072363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.072363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.085110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:53.086470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:53.143132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:53.167154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1290/2578] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:53.176767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.177068 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.177353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.199012 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:53.200329 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:53.209349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1289/2579] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:53.215856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.226566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1635c-c7f6-4299-82c6-c48f7ad52019 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.233282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.233952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.234263 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.234546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.235409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:53.235995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.238109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.252077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1291/2580] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:53.256634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.267218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1916df-6a65-4b4f-8c95-148530f364fa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.272404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.273132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.273468 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.273769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.274545 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.276482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.427549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1290/2581] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:53 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:53.431755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.442711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1b81-c363-4adb-9c97-4b67c2029a5a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.501548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.502561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.502853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.503136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.503894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.505899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.620680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1292/2582] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:53 2022] POST /identity/v3/users => generated 280 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:53.625435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.644386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201254a4-cc47-4e54-9050-b1bee9536eba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.649228 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.649897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.650188 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.650522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.651257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.652901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.664640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1291/2583] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:53.668955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.680128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dbaaf-da78-4170-ad74-d4d3d2c0083d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.684926 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.685585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.685905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.686925 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.687724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.689443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d820-7ce2-4845-be57-1ba659ff4777 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.700756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1293/2584] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:53.704971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.715289 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49c-8231-49d4-b16d-51005c38714b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:53.720607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:53.721522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.721843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.722145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] PATH_INFO: `/v3/projects/572e583224664b39be94da41c26f99c7/users/618891d6678a4c6ca4fb21f192074597/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.737388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572e583224664b39be94da41c26f99c7, user_id=618891d6678a4c6ca4fb21f192074597, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:53.740103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:53.825796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1292/2585] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:53 2022] PUT /identity/v3/projects/572e583224664b39be94da41c26f99c7/users/618891d6678a4c6ca4fb21f192074597/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:53.836292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:53.836593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:53.836907 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:53.864637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] MFA Rules not processed for user `618891d6678a4c6ca4fb21f192074597`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:53.865916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:53.932567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1294/2586] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:53.964197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:53.966138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:54.028990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202851b2-0ec3-407b-bfc8-8728151a3fa0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:54.033274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:54.033965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:54.034313 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:54.034595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:54.043513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:54.044960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0ecb7-0b96-471a-bcca-9d2342783859 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:54.054888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1293/2587] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:54.069710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:54.118665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:54.141488 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b7075-2f0b-4f2e-b1e2-b5dbeeece2ab None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:54.146430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:54.147310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:54.147629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:54.147912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] PATH_INFO: `/v3/users/618891d6678a4c6ca4fb21f192074597` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:54.149159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618891d6678a4c6ca4fb21f192074597)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:54.151163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:54.364944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618891d6678a4c6ca4fb21f192074597'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:54.365650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618891d6678a4c6ca4fb21f192074597'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:54.366432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618891d6678a4c6ca4fb21f192074597'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:54.386840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618891d6678a4c6ca4fb21f192074597'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:54.459662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618891d6678a4c6ca4fb21f192074597'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:54.473508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1295/2588] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:54 2022] DELETE /identity/v3/users/618891d6678a4c6ca4fb21f192074597 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:54.477913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:54.478350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:54.478668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:54.497170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:54.498428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:54.561259 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1294/2589] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:54.572101 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:54.573624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:54.639022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70963c84-3ad0-4a21-990b-61e1ea475572 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:54.643519 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:54.644277 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:54.644579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:54.644932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:54.655769 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:54.657288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ad70-d67c-4674-970c-ebd864d62a5d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:54.666969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1296/2590] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:55.134635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.150434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:55.152063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3d1b0-bd37-4c8b-b057-aa0862c20c9d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.157368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.158348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.158625 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.159076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] PATH_INFO: `/v3/projects/572e583224664b39be94da41c26f99c7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.160393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=572e583224664b39be94da41c26f99c7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.162396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.171280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:55.313594 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572e583224664b39be94da41c26f99c7', 'request_id': 'req-fce916b2-8ac2-4874-8253-3619d27af5cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:55.397046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572e583224664b39be94da41c26f99c7', 'request_id': 'req-fce916b2-8ac2-4874-8253-3619d27af5cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:55.404264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572e583224664b39be94da41c26f99c7', 'request_id': 'req-fce916b2-8ac2-4874-8253-3619d27af5cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:55.423740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] The token cache is being invalidate because project 572e583224664b39be94da41c26f99c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:37:55.424197 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:55.425025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fce916b2-8ac2-4874-8253-3619d27af5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:55.427218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1295/2591] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:37:55 2022] DELETE /identity/v3/projects/572e583224664b39be94da41c26f99c7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:55.432363 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.432876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.433004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.455175 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:55.456419 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:55.519359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1297/2592] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:55.527328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.527671 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.527905 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.548415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:55.549666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:55.558982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1296/2593] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:55.563250 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.569507 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:55.573535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12feb-29f0-47af-ad1c-acb2ae175cfb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.578814 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.579471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.579756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.580041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.580755 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:37:55.581066 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.582739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.595598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1298/2594] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:37:55.600000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.609600 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afed010-93de-4af5-88c4-537cf23f2fdb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.614488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.615159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.615568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.615854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.616554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.618562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.725049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1297/2595] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:37:55.729309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.739335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aea6b-f026-4881-aa3b-f7b19988259a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.798623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.799298 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.799589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.799901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.800607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.803003 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.877104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1299/2596] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:37:55 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:37:55.881506 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.893325 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22244-d35f-4dba-a61e-c8626e415dc1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.898370 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.899044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.899331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.899656 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.900505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.902153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.913951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1298/2597] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:37:55.918238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.928479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc32d-7ce0-423c-828e-30052279aeda admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.933076 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.933734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.934021 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.934331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.935082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.936673 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30513a-ba24-4fc4-b330-2c4c6c70faba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:55.949996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1300/2598] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:37:55.951591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:55.962523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975acbd-3a83-4154-b3f6-8a564f430172 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:55.967354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:55.968238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:55.968529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:55.968846 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] PATH_INFO: `/v3/projects/07329cd8111e44d1b36b207a2f518584/users/ed6cc9c7c466467782f1a7bb5dbf5515/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:55.984796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07329cd8111e44d1b36b207a2f518584, user_id=ed6cc9c7c466467782f1a7bb5dbf5515, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:55.987565 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:56.086857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1299/2599] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:37:55 2022] PUT /identity/v3/projects/07329cd8111e44d1b36b207a2f518584/users/ed6cc9c7c466467782f1a7bb5dbf5515/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:37:56.153945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:56.154171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:56.154493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:56.182232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] MFA Rules not processed for user `ed6cc9c7c466467782f1a7bb5dbf5515`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:56.183478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:56.253871 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1301/2600] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:37:56.266480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:56.270252 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:56.327994 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7809-98a7-4115-b5e9-50a0bd001ec6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:56.332558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:56.332964 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:56.333249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:56.333528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:56.342080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:56.343592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a5091-339a-464c-926e-7daba3beba98 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:56.353380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1300/2601] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:37:59.530656 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:59.595759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec49f84-dd1d-4439-85a4-a230256547dd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:37:59.601229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:37:59.602326 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:59.602724 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:59.603135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] PATH_INFO: `/v3/users/ed6cc9c7c466467782f1a7bb5dbf5515` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:59.604671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6cc9c7c466467782f1a7bb5dbf5515)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:37:59.606950 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:37:59.614733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:59.776228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6cc9c7c466467782f1a7bb5dbf5515'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:59.776812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6cc9c7c466467782f1a7bb5dbf5515'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:59.777421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6cc9c7c466467782f1a7bb5dbf5515'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:59.791500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6cc9c7c466467782f1a7bb5dbf5515'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:59.859170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6cc9c7c466467782f1a7bb5dbf5515'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:37:59.874060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1302/2602] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:37:59 2022] DELETE /identity/v3/users/ed6cc9c7c466467782f1a7bb5dbf5515 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:37:59.879929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:37:59.880773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:37:59.881058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:37:59.897980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:37:59.899247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:37:59.931781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:37:59.960003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1301/2603] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:37:59.970217 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:37:59.975023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:00.041558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7bc0a-a543-4aab-93cd-c248540537ad admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:00.045703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:00.046574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.046776 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.047627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.057469 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:00.059471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d42d7-f930-4efe-ab6b-ee1c4284cd87 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:00.077293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1303/2604] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:00.541279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:00.542792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:00.556877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b148-5364-49f8-a00e-7e0f216afbd9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:00.563446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:00.565695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.565695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.565695 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] PATH_INFO: `/v3/projects/07329cd8111e44d1b36b207a2f518584` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.567088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07329cd8111e44d1b36b207a2f518584)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:00.570386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:00.677822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07329cd8111e44d1b36b207a2f518584', 'request_id': 'req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:00.768045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07329cd8111e44d1b36b207a2f518584', 'request_id': 'req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:00.774990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07329cd8111e44d1b36b207a2f518584', 'request_id': 'req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:00.786828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] The token cache is being invalidate because project 07329cd8111e44d1b36b207a2f518584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:00.789333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:00.789333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05ec12ba-dd95-425a-9ef9-c9ccc81cfea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:00.789333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1302/2605] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:00 2022] DELETE /identity/v3/projects/07329cd8111e44d1b36b207a2f518584 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:00.794432 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.794945 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.795145 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.813700 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:00.814966 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:00.874668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1304/2606] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:00.882716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.883203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.883304 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.902630 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:00.903851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:00.912564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1303/2607] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:00.926085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:00.936137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0cdf-7a9f-46e8-8023-dc577b9b0d73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:00.941031 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:00.941688 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.941971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.942283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.943258 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:00.943566 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:00.945176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:00.959709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1305/2608] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:00.964626 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:00.974755 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c1af-b2b7-43aa-8a6e-124c48922336 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:00.979593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:00.980258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:00.980574 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:00.980818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:00.981508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:00.983509 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.089008 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1304/2609] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:00 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:01.092973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:01.104078 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b26a-0cbe-451a-9711-0a98f51206b9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:01.109011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:01.161597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:01.162358 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.162651 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.163454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.163733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:01.165810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.284983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1306/2610] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:01 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:01.292043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:01.303057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430c9a-bd09-426e-bbab-adf0bfc63659 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:01.308103 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:01.308801 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.309089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.309372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.310148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:01.311819 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.323215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1305/2611] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:01.327493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:01.338490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e77a7a-d748-4c38-b2c3-c12264a0a7d0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:01.343280 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:01.344017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.344371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.344719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.345454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:01.347090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3e56c-230a-488f-aedf-3cbfb300bba0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.358797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1307/2612] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:01.364152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:01.376495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150af66f-90f9-4a21-83ea-43555451ec1d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:01.381580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:01.382596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.382817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.383101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] PATH_INFO: `/v3/projects/b5e4ed6911ee482cbe4dbaad2b88292e/users/05506c35ed2744979aceaceaad15c6f0/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.400660 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e4ed6911ee482cbe4dbaad2b88292e, user_id=05506c35ed2744979aceaceaad15c6f0, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:01.403384 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.516678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1306/2613] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:01 2022] PUT /identity/v3/projects/b5e4ed6911ee482cbe4dbaad2b88292e/users/05506c35ed2744979aceaceaad15c6f0/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:01.523429 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.523727 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.524065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.552100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] MFA Rules not processed for user `05506c35ed2744979aceaceaad15c6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:01.553467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:01.624257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1308/2614] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:01.635833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:01.637654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:01.696551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a86a6-9a80-467e-9e91-3c0397196733 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:01.700202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:01.700853 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:01.701145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:01.701446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:01.710136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:01.711638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a653d5-18dc-4438-8c44-5da61332a4c9 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:01.715350 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:01.721154 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1307/2615] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:05.828844 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:05.830342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:05.898329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca5af-430a-4c7c-bb0d-dba1271f24ae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:05.903034 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:05.903911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:05.904198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:05.904479 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] PATH_INFO: `/v3/users/cf2343af66234c6db649662273fb31be` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:05.905671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2343af66234c6db649662273fb31be)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:05.908465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:05.931490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:06.174503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2343af66234c6db649662273fb31be'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:06.175227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2343af66234c6db649662273fb31be'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:06.176154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2343af66234c6db649662273fb31be'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:06.189748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2343af66234c6db649662273fb31be'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:06.251823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2343af66234c6db649662273fb31be'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:06.266405 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1309/2616] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:05 2022] DELETE /identity/v3/users/cf2343af66234c6db649662273fb31be => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:06.271704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:06.272248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:06.272248 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:06.290397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:06.291629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:06.361652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1308/2617] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:06.369865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:06.371555 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:06.441426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc2aaa-63a4-427b-831c-ec118bef9e50 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:06.448322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:06.449099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:06.449288 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:06.449563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:06.462382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:06.467511 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:06.478721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1310/2618] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:07.034542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:07.036073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:07.050349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643fca-cb09-465c-9c5b-680dbbf17d79 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:07.057783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:07.057783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:07.057783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:07.057783 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] PATH_INFO: `/v3/projects/8f150388aec84f31a270940f2369362e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:07.058834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f150388aec84f31a270940f2369362e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:07.061089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:07.238364 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f150388aec84f31a270940f2369362e', 'request_id': 'req-0c66ea82-8f29-4b14-b261-92fdf2d5a933'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.322457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f150388aec84f31a270940f2369362e', 'request_id': 'req-0c66ea82-8f29-4b14-b261-92fdf2d5a933'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.330597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f150388aec84f31a270940f2369362e', 'request_id': 'req-0c66ea82-8f29-4b14-b261-92fdf2d5a933'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.342080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] The token cache is being invalidate because project 8f150388aec84f31a270940f2369362e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:07.342723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.343352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.345673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1309/2619] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:07 2022] DELETE /identity/v3/projects/8f150388aec84f31a270940f2369362e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:07.350719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:07.365859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cfca-c335-4ee7-83ac-7626e41dc99d service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:07.458264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:07.458264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:07.458264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:07.458264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] PATH_INFO: `/v3/users/2df70841edd24e829d45aaea3e293366` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:07.458592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df70841edd24e829d45aaea3e293366)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:07.460693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:07.768703 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:07.775151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df70841edd24e829d45aaea3e293366'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.775851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df70841edd24e829d45aaea3e293366'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.776474 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df70841edd24e829d45aaea3e293366'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.793552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df70841edd24e829d45aaea3e293366'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.945740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a8ed837-6fcc-4951-ad60-c0407ef250d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df70841edd24e829d45aaea3e293366'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:07.962355 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1311/2620] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:07 2022] DELETE /identity/v3/users/2df70841edd24e829d45aaea3e293366 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:08.439504 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:08.441285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:08.459822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ea82-8f29-4b14-b261-92fdf2d5a933 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:08.542901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:08.543767 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:08.544058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:08.544339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] PATH_INFO: `/v3/projects/87449f8893ef49bf95ba3f1457c45ca6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:08.545688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=87449f8893ef49bf95ba3f1457c45ca6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:08.548221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:08.593061 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:08.700411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87449f8893ef49bf95ba3f1457c45ca6', 'request_id': 'req-95997360-0178-4d97-8709-8f91c17795ef'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:08.790615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87449f8893ef49bf95ba3f1457c45ca6', 'request_id': 'req-95997360-0178-4d97-8709-8f91c17795ef'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:08.799260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87449f8893ef49bf95ba3f1457c45ca6', 'request_id': 'req-95997360-0178-4d97-8709-8f91c17795ef'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:08.812829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] The token cache is being invalidate because project 87449f8893ef49bf95ba3f1457c45ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:08.813148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:08.813808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-95997360-0178-4d97-8709-8f91c17795ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:08.815692 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1310/2621] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:08 2022] DELETE /identity/v3/projects/87449f8893ef49bf95ba3f1457c45ca6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:08.822430 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053724-9ed2-482f-a120-436fb67c930b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:08.822932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053724-9ed2-482f-a120-436fb67c930b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:08.823018 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053724-9ed2-482f-a120-436fb67c930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:08.847457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-53053724-9ed2-482f-a120-436fb67c930b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:08.848704 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-53053724-9ed2-482f-a120-436fb67c930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:08.954639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1312/2622] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:08.962560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:08.962879 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:08.963182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:08.982469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:08.983680 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:08.992924 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1311/2623] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:08.997232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53053724-9ed2-482f-a120-436fb67c930b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.008196 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53053724-9ed2-482f-a120-436fb67c930b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.012840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.013503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.017165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.017165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.017165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:09.017165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.017165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.031539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1313/2624] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:09.036421 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.045982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e1b5-dfb3-45c4-bb31-f2b985ce68bb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.053258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.053941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.054266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.054554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.055283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.057627 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.210775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1312/2625] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:09.215005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.227230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94203a-7dbd-482a-a670-f09e82838119 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.289979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.290977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.291264 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.291543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.292244 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.294179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.431560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1314/2626] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:09 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:09.436038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.448160 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff94c5-4817-4cf8-9585-0e5aae183afa admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.453580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.454554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.454872 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.455156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.455896 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.457657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.468900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1313/2627] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:09.472992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.483498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50571-5cc7-4750-bcb8-aa33e1283d3f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.488340 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.489002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.489293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.489574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.490336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.491989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d928-9ff6-4b99-bc55-1cc78488b6e5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.503179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1315/2628] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:09.507544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.518529 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486c86-55e6-4e35-a057-f7919f5577a5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.523411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.524298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.524593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.524874 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] PATH_INFO: `/v3/projects/3d1554002cfb4dbf92d9e5fe6a99b720/users/43d65f90befa4dfab67c5db4e4aca6de/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.540615 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1554002cfb4dbf92d9e5fe6a99b720, user_id=43d65f90befa4dfab67c5db4e4aca6de, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.543371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:09.676745 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1314/2629] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:09 2022] PUT /identity/v3/projects/3d1554002cfb4dbf92d9e5fe6a99b720/users/43d65f90befa4dfab67c5db4e4aca6de/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:09.691799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.692090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.692376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.728423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] MFA Rules not processed for user `43d65f90befa4dfab67c5db4e4aca6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:09.730341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:09.745852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:09.811210 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1316/2630] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:09.816285 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:09.894411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5dd3-ac8c-44e0-936b-416c290a5b7b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:09.900243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:09.900920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:09.901204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:09.901579 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:09.902224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:09.904164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.007337 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1315/2631] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:10.011898 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.024706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b9e2-17f5-45d5-a6a3-33e7d42d91c3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.098885 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.099497 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.099783 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.100065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.100759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.103072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.248493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1317/2632] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:10 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:10.253377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.264174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3025-2b5c-4bca-943e-53cbf436e308 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.269586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.270336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.270629 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.270911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.271644 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.273256 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.288781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1316/2633] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:10.289875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.300402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4bbf-cbda-484f-acbf-eed39db897c8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.305323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.306153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.306482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.306767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] PATH_INFO: `/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35/users/ae2d7832a3de49ea914a876dbd17097f/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.323763 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e848acd42a41c2a5c086a3a35c2a35, user_id=ae2d7832a3de49ea914a876dbd17097f, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.326451 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.495276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1318/2634] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:10 2022] PUT /identity/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35/users/ae2d7832a3de49ea914a876dbd17097f/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:10.499498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.511275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e8a1-d75c-4aa5-9b22-1719d466ce1c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.531977 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:10.570602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.571293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.571607 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.571886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.572652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.574286 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af620-ba89-467d-9b33-e1c4e5682846 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.585397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1317/2635] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:10.589880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.601139 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e78b6-b436-47dd-ae17-7109e8a7ad27 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.606271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.607584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.608056 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.608346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] PATH_INFO: `/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35/users/ae2d7832a3de49ea914a876dbd17097f/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.611243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e848acd42a41c2a5c086a3a35c2a35, user_id=ae2d7832a3de49ea914a876dbd17097f, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.613972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.633689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1319/2636] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:10 2022] PUT /identity/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35/users/ae2d7832a3de49ea914a876dbd17097f/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:10.645447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.645741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.646029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.675241 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] MFA Rules not processed for user `ae2d7832a3de49ea914a876dbd17097f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:10.676481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:10.748555 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1318/2637] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:10.760605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:10.762698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:10.823378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeec2-c17f-4187-a58a-a0d37ff73904 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:10.827070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:10.827821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:10.828114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:10.828399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:10.839652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:10.842251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4c20d-5434-411e-95dd-7b5767e522db service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:10.851983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1320/2638] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:12.315413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:12.380704 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cda3d-0dcb-4802-a472-9d37b5588520 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:12.386011 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:12.386928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:12.387230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:12.387515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] PATH_INFO: `/v3/users/43d65f90befa4dfab67c5db4e4aca6de` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:12.388811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d65f90befa4dfab67c5db4e4aca6de)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:12.390796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:12.603132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:12.604752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d65f90befa4dfab67c5db4e4aca6de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:12.605429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d65f90befa4dfab67c5db4e4aca6de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:12.699666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d65f90befa4dfab67c5db4e4aca6de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:12.707779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d65f90befa4dfab67c5db4e4aca6de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:12.708415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d65f90befa4dfab67c5db4e4aca6de'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:12.728054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1319/2639] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:12 2022] DELETE /identity/v3/users/43d65f90befa4dfab67c5db4e4aca6de => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:12.732689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:12.733161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:12.733290 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:12.756042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:12.757276 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:12.762667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:12.849026 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:12.850328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1321/2640] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:12.853480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:12.858760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:12.860680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:12.922353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f8d95-8163-444b-b74c-a5b09e8a8835 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:12.925417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db33ee-c60b-44ad-b1aa-ba62fe1e0504 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:12.926279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:12.926973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:12.927254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:12.927665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:12.929554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:12.930253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:12.930549 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:12.930833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:12.932797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:12.938329 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:12.939778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:12.946145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:12.948063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:12.965142 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1320/2642] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:12.965339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1322/2642] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:13.619621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:13.622264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:13.635515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b2d9-aa56-4c2e-8422-0a30888ab49a service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:13.651996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:13.653110 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:13.653508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:13.653697 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] PATH_INFO: `/v3/projects/3d1554002cfb4dbf92d9e5fe6a99b720` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:13.655432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1554002cfb4dbf92d9e5fe6a99b720)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:13.657437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:13.779009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1554002cfb4dbf92d9e5fe6a99b720', 'request_id': 'req-4af25227-010f-4a00-9394-340dfdcad701'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:13.876965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1554002cfb4dbf92d9e5fe6a99b720', 'request_id': 'req-4af25227-010f-4a00-9394-340dfdcad701'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:13.885657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1554002cfb4dbf92d9e5fe6a99b720', 'request_id': 'req-4af25227-010f-4a00-9394-340dfdcad701'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:13.900628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] The token cache is being invalidate because project 3d1554002cfb4dbf92d9e5fe6a99b720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:13.901077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:13.901890 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:13.906982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1321/2643] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:13 2022] DELETE /identity/v3/projects/3d1554002cfb4dbf92d9e5fe6a99b720 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:13.908832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:13.922123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e57c-5659-40b3-81f5-5fdb4c00c1b7 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:14.003087 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:14.003964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:14.004246 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:14.004527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] PATH_INFO: `/v3/users/ae2d7832a3de49ea914a876dbd17097f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:14.005728 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2d7832a3de49ea914a876dbd17097f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:14.007709 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:14.261669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2d7832a3de49ea914a876dbd17097f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:14.263434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2d7832a3de49ea914a876dbd17097f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:14.263434 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2d7832a3de49ea914a876dbd17097f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:14.270416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:14.280853 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2d7832a3de49ea914a876dbd17097f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:14.414148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e188caa5-80ce-457c-af61-d0726a41b1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2d7832a3de49ea914a876dbd17097f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:14.429310 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1323/2644] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:13 2022] DELETE /identity/v3/users/ae2d7832a3de49ea914a876dbd17097f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:15.114558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.117062 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:15.146701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af25227-010f-4a00-9394-340dfdcad701 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:15.218371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:15.230597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:15.231756 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.234718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.234718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] PATH_INFO: `/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.234718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e848acd42a41c2a5c086a3a35c2a35)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:15.236164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:15.338699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e848acd42a41c2a5c086a3a35c2a35', 'request_id': 'req-3f288b66-de3c-46bb-be4d-00d955dbfb7c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.406404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e848acd42a41c2a5c086a3a35c2a35', 'request_id': 'req-3f288b66-de3c-46bb-be4d-00d955dbfb7c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.413485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e848acd42a41c2a5c086a3a35c2a35', 'request_id': 'req-3f288b66-de3c-46bb-be4d-00d955dbfb7c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.425106 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] The token cache is being invalidate because project c8e848acd42a41c2a5c086a3a35c2a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:15.425411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.426097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.427963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1322/2645] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:15 2022] DELETE /identity/v3/projects/c8e848acd42a41c2a5c086a3a35c2a35 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:15.432706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ce81-77f4-4560-ad37-c74b1787b8e9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.433185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ce81-77f4-4560-ad37-c74b1787b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.433304 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ce81-77f4-4560-ad37-c74b1787b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.457774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7e46ce81-77f4-4560-ad37-c74b1787b8e9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:15.459061 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7e46ce81-77f4-4560-ad37-c74b1787b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:15.536192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.537811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:15.565162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1324/2646] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:38:15.565494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288b66-de3c-46bb-be4d-00d955dbfb7c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:15.565494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:15.565494 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.566332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.566332 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] PATH_INFO: `/v3/users/1b7a64788ed14989a4a0a97f67adf97e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.567454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.567739 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7a64788ed14989a4a0a97f67adf97e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:15.567923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.568259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.569882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:15.594672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:15.596107 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:15.606154 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1325/2647] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:15.611325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.621554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84cc1-db68-423d-9154-97af58545092 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:15.628753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:15.629928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.630876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.630876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.631600 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:15.631913 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:15.633563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:15.647455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1326/2648] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:15.654392 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.665157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9cf76-3339-45f6-80cc-70af49258d1c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:15.670005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:15.670701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.670992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.671274 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.671971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:15.673918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:15.779514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1327/2649] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:15 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:15.783596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.849672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deea8-9d0d-4e5e-a803-c38136426e0e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:15.854682 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:15.855527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:15.855710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:15.856047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:15.856759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:15.859411 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:15.873306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7a64788ed14989a4a0a97f67adf97e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.873965 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7a64788ed14989a4a0a97f67adf97e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.947171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7a64788ed14989a4a0a97f67adf97e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.959564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1328/2650] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:15 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:15.965360 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7a64788ed14989a4a0a97f67adf97e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.968690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f1e3786e-dc27-4fb5-8408-1201a7278e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7a64788ed14989a4a0a97f67adf97e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:15.973247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:15.981346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:16.004291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736df3e-14a6-4e8c-bb22-21ed942e360e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.008595 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1323/2651] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:15 2022] DELETE /identity/v3/users/1b7a64788ed14989a4a0a97f67adf97e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:16.011312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.012170 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.012480 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.012931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.014455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.014946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.015586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.016052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.016618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:16.029572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1329/2652] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:16.033893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:16.038416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:16.039843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:16.044915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0151aca-5f1a-41ba-b829-552f95820f06 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.051224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:16.113471 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.114165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.114494 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.114773 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.115505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.117110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:16.122368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1324/2653] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:38:16.130796 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1330/2654] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:16.135822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:16.137418 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:16.140139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:16.162738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba405-ac09-4019-aad0-192a75c82fec admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.178357 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.179248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.179541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.179828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] PATH_INFO: `/v3/projects/a957aa2e4b694786983f7c9b0b96e4b5/users/b04c98f43fa9428aa70cd6428702f73f/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.205964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a957aa2e4b694786983f7c9b0b96e4b5, user_id=b04c98f43fa9428aa70cd6428702f73f, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.214998 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:16.241557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2da3-7c38-4735-8a90-15194c3257ec None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.246000 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.246989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.247426 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.247876 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.258716 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.260163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496ce13-dc29-496a-99c9-c8bebfdf3c96 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:16.271398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1325/2655] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:16.335696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1331/2656] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:16 2022] PUT /identity/v3/projects/a957aa2e4b694786983f7c9b0b96e4b5/users/b04c98f43fa9428aa70cd6428702f73f/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:16.346966 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.347263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.347543 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.381237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] MFA Rules not processed for user `b04c98f43fa9428aa70cd6428702f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:16.384019 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:16.388202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:16.477303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1326/2657] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:16.481806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:16.559194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d030-26e0-4aa0-a8f4-6d82a302fe32 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.565041 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.565761 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.566052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.566361 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.567065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.569060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:16.861347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1332/2658] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:16 2022] POST /identity/v3/projects => generated 381 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:16.862292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:16.878063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bb4f0-a246-4ec0-8455-3e1af8fbe8fb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:16.965631 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:16.966357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:16.966652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:16.966932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:16.967679 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:16.970205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.077254 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.080104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.081273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1327/2659] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:16 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:17.084969 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.095635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5143b0-f4fe-47fa-b61c-ed800c79cf45 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.101475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.103669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.103669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.103669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.103669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.105195 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.117955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1328/2660] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:17.122458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.126005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a21b91-9bc0-4e93-835b-e281f902837a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.133938 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.134970 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd04de-7ff6-4204-a920-7ad6c08802b8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.135549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.138000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.138000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] PATH_INFO: `/v3/projects/965d4b70a5dd4ecc9ada262a21131ff0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.138000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965d4b70a5dd4ecc9ada262a21131ff0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.140808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.140936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.141956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.142334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.142718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] PATH_INFO: `/v3/projects/9447a1159cf345f48cb1266ff2244de1/users/a3a48c36adda4b6694f34943d1a974d8/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.159014 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9447a1159cf345f48cb1266ff2244de1, user_id=a3a48c36adda4b6694f34943d1a974d8, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.166620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.264126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965d4b70a5dd4ecc9ada262a21131ff0', 'request_id': 'req-967a1072-f9a1-4931-9f03-87ef417d3980'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.269757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1329/2661] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:17 2022] PUT /identity/v3/projects/9447a1159cf345f48cb1266ff2244de1/users/a3a48c36adda4b6694f34943d1a974d8/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:17.272834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.344414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e67641-68c0-42e3-9ff8-cf9d651f144d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.351722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965d4b70a5dd4ecc9ada262a21131ff0', 'request_id': 'req-967a1072-f9a1-4931-9f03-87ef417d3980'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.360309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965d4b70a5dd4ecc9ada262a21131ff0', 'request_id': 'req-967a1072-f9a1-4931-9f03-87ef417d3980'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.372291 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] The token cache is being invalidate because project 965d4b70a5dd4ecc9ada262a21131ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:17.372577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.373224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.375659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1333/2662] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:17 2022] DELETE /identity/v3/projects/965d4b70a5dd4ecc9ada262a21131ff0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:17.376351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.378016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.407143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.407857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.408148 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.408433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.409201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.410901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dcb25-a152-41fe-8581-43503df95f79 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.420938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1330/2663] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:17.422788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.423086 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.423381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.455556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a1072-f9a1-4931-9f03-87ef417d3980 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.458768 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:17.460020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.461152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.461810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.462255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.462543 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.464394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.468878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1331/2664] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:17.470280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.471336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.483127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.484353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e53c8e-d058-43ee-a4be-bb5b3043ad11 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.485551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.490243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.490888 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.491183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.491470 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] PATH_INFO: `/v3/projects/9447a1159cf345f48cb1266ff2244de1/users/a3a48c36adda4b6694f34943d1a974d8/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.493621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9447a1159cf345f48cb1266ff2244de1, user_id=a3a48c36adda4b6694f34943d1a974d8, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.495008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:17.496348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c67f1-5d2c-41fd-8928-00f2216b9cfe admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.500889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1334/2665] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:17.501717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.503424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.508941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1332/2666] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:17 2022] PUT /identity/v3/projects/9447a1159cf345f48cb1266ff2244de1/users/a3a48c36adda4b6694f34943d1a974d8/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:17.510562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c854cd-f5b4-4a8f-b1c1-194545da56b3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.511076 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c854cd-f5b4-4a8f-b1c1-194545da56b3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.511670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c854cd-f5b4-4a8f-b1c1-194545da56b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.518689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc728c-f82c-479a-9190-141161cbf802 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.545333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f1c854cd-f5b4-4a8f-b1c1-194545da56b3 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:17.547825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f1c854cd-f5b4-4a8f-b1c1-194545da56b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.588380 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.589562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.589852 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.590134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] PATH_INFO: `/v3/users/fdc5beed67fc45f588145a525a12e1e4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.591422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc5beed67fc45f588145a525a12e1e4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.593541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.610501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1333/2667] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:17.612434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.612434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.612434 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.640634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] MFA Rules not processed for user `a3a48c36adda4b6694f34943d1a974d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:17.658450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.726070 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1334/2668] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:17.727647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.745593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c234ec2-1c12-4c84-bcf4-583f2c611816 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.750984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.751719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.752122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.755903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.755903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:17.755903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.755903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.768163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1335/2669] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:17.773231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.776609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:17.835371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19589e-8075-4454-b6ef-8bfc59ba9124 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.839522 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.840109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.840537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.840820 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.851163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.852661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.863564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1336/2670] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:17.864420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:17.875303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9e41a-adfa-4d01-8c4e-78d130e1ce49 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:17.877316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:17.882365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:17.883120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:17.883410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:17.883850 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:17.884507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:17.886639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:17.895348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc5beed67fc45f588145a525a12e1e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.896138 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc5beed67fc45f588145a525a12e1e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.896834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc5beed67fc45f588145a525a12e1e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:17.913657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc5beed67fc45f588145a525a12e1e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.013641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc5beed67fc45f588145a525a12e1e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.025336 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1337/2671] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:17 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:18.026515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.028334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.036857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1335/2672] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:17 2022] DELETE /identity/v3/users/fdc5beed67fc45f588145a525a12e1e4 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:18.137568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a603-8464-4757-84c3-f42e50868273 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.221502 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:18.233353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.234617 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.234907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.235303 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.235941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.239975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.359804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.362738 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:18.365952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.375479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1338/2673] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:18 2022] POST /identity/v3/users => generated 299 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:18.377498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.380991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef0a34-fc42-4b53-933a-66f41c4c42dc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.387119 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.388069 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.388460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.388835 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] PATH_INFO: `/v3/projects/8fc00a591025456585e5adfb93e7bc5a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.389230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21861877-1bf5-44e6-a183-02dfc9a312ea admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.390376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc00a591025456585e5adfb93e7bc5a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.395007 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.395528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.395842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.396462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.396462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.397092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.398762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.409079 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1339/2674] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:18.413055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.423854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba5526-0219-494c-894e-79dcc1e67705 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.428593 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.429243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.429532 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.429843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.446130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.446130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.446130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1340/2675] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:18.448923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.458675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf6afc-dab2-449b-afda-4bc54d7c76f1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.463536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.464391 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.464987 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.465438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] PATH_INFO: `/v3/projects/3fc602912c9d4156b0427fff8dac8c5c/users/3f5b8cf5bf3741f28d7db956626a15e3/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.481140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc602912c9d4156b0427fff8dac8c5c, user_id=3f5b8cf5bf3741f28d7db956626a15e3, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.484553 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.568536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1341/2676] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:18 2022] PUT /identity/v3/projects/3fc602912c9d4156b0427fff8dac8c5c/users/3f5b8cf5bf3741f28d7db956626a15e3/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:18.569974 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.571067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.586226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc00a591025456585e5adfb93e7bc5a', 'request_id': 'req-35b32f5d-d490-4434-a9bf-5741e9009ab0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.635292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51de78-9742-4c65-8c63-f35462539729 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.651862 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc00a591025456585e5adfb93e7bc5a', 'request_id': 'req-35b32f5d-d490-4434-a9bf-5741e9009ab0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.658400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc00a591025456585e5adfb93e7bc5a', 'request_id': 'req-35b32f5d-d490-4434-a9bf-5741e9009ab0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.667327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:18.670111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] The token cache is being invalidate because project 8fc00a591025456585e5adfb93e7bc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:18.670391 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.671441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-35b32f5d-d490-4434-a9bf-5741e9009ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.672663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1336/2677] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:18 2022] DELETE /identity/v3/projects/8fc00a591025456585e5adfb93e7bc5a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:18.675455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094627-2064-41d0-9b78-56cbe93861c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.675757 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094627-2064-41d0-9b78-56cbe93861c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.676255 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094627-2064-41d0-9b78-56cbe93861c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.700662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.701541 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.701855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.702131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] PATH_INFO: `/v3/users/b04c98f43fa9428aa70cd6428702f73f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.703510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b9094627-2064-41d0-9b78-56cbe93861c5 None None] MFA Rules not processed for user `3f5b8cf5bf3741f28d7db956626a15e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:18.703972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04c98f43fa9428aa70cd6428702f73f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.704876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b9094627-2064-41d0-9b78-56cbe93861c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.706032 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.769409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1337/2678] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:18.770729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659452b8-2978-41ac-844f-602128e90570 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.771017 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659452b8-2978-41ac-844f-602128e90570 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.771293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659452b8-2978-41ac-844f-602128e90570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.790567 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-659452b8-2978-41ac-844f-602128e90570 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:18.791818 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-659452b8-2978-41ac-844f-602128e90570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.800097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1338/2679] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:18.801033 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659452b8-2978-41ac-844f-602128e90570 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.802283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-659452b8-2978-41ac-844f-602128e90570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.860716 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659452b8-2978-41ac-844f-602128e90570 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.864678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.869435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.869435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.869435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.876081 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.877518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d496-350c-4a07-8330-dc76ec4a8d84 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.888159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1339/2680] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:18.888568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.888854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.889133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.908538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04c98f43fa9428aa70cd6428702f73f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.909597 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04c98f43fa9428aa70cd6428702f73f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:18.911657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:18.912893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:18.925903 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1340/2681] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:18.930015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.939889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06284-712f-49cb-8206-e940b6e023fc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.944780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.945449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.945745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.946027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.946787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:18.947102 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.948803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:18.963460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1341/2682] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:18.970989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:18.983422 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d7ced-b35a-4beb-951a-0652ddd79410 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:18.991317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:18.991317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:18.991931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:18.992252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:18.993029 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:18.995065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.008764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04c98f43fa9428aa70cd6428702f73f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:19.021621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04c98f43fa9428aa70cd6428702f73f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:19.021621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe1bff-dea5-46cc-ba7f-3aa1b80d75c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04c98f43fa9428aa70cd6428702f73f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:19.040435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1342/2683] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:18 2022] DELETE /identity/v3/users/b04c98f43fa9428aa70cd6428702f73f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:19.050558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.050922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.051282 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.070815 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:19.072048 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:19.113349 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1342/2684] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:18 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:19.114004 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.136496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1343/2685] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:19.146852 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.148433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:19.160856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:19.199685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0b86-c006-45fc-8779-fdb0e7a6d80c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.204612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.205354 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.205707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.205990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.212578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.214588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.220372 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4d20-86d1-413f-91a0-349282316cf8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.243082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:19.272009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.272670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.272960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.273317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.285362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.287833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.298937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1344/2686] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:19.318236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1343/2687] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:19 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:19.321057 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.330990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-58d9-4ce0-99bd-9dce9e7460ce service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.336294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.336968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.337294 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.337577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.338346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.339955 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.350859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1345/2688] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:19.355424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.366987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e68c-4f26-47fe-84fd-4a191db8a813 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.372287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.372964 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.373259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.373538 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.374321 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.376848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d884af-faaa-4907-ac43-9d394666995d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.389952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1344/2689] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:19.393842 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.404146 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb56e3-4383-4196-84a6-a1d5267e4d29 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.409566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.410582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.410868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.411150 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] PATH_INFO: `/v3/projects/260838b8e8264aa39e8f21dd6ebe9c5b/users/4250561a249a4a1581c3ddfb6cd1b3fc/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.426954 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] RBAC: Authorizing `identity:create_grant(project_id=260838b8e8264aa39e8f21dd6ebe9c5b, user_id=4250561a249a4a1581c3ddfb6cd1b3fc, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.429698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.505192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1346/2690] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:19 2022] PUT /identity/v3/projects/260838b8e8264aa39e8f21dd6ebe9c5b/users/4250561a249a4a1581c3ddfb6cd1b3fc/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:19.515104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.515404 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.515690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.544006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] MFA Rules not processed for user `4250561a249a4a1581c3ddfb6cd1b3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:19.545243 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:19.623345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1345/2691] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:19.642798 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.644637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:19.726847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417db7-91ae-4ca4-9a33-73452f67114d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.733513 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.734665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.735035 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.735418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.745244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.746993 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.757139 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1347/2692] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:19.773717 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:19.775356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:19.850492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b8584-a1ee-41a9-be2d-a240b9915468 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:19.855596 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:19.856679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:19.856915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:19.857209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] PATH_INFO: `/v3/projects/a957aa2e4b694786983f7c9b0b96e4b5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:19.858725 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a957aa2e4b694786983f7c9b0b96e4b5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:19.860859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:19.998591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a957aa2e4b694786983f7c9b0b96e4b5', 'request_id': 'req-f1332e49-653a-489d-b2fa-5e8e3c86009a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.086370 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a957aa2e4b694786983f7c9b0b96e4b5', 'request_id': 'req-f1332e49-653a-489d-b2fa-5e8e3c86009a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.086568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:20.092334 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a957aa2e4b694786983f7c9b0b96e4b5', 'request_id': 'req-f1332e49-653a-489d-b2fa-5e8e3c86009a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.103958 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] The token cache is being invalidate because project a957aa2e4b694786983f7c9b0b96e4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:20.104235 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.104892 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.106492 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1346/2693] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:19 2022] DELETE /identity/v3/projects/a957aa2e4b694786983f7c9b0b96e4b5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:20.110670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:20.120989 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001940-05c7-4d60-a401-d42095cd5fba service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:20.177023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:20.177895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:20.178255 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:20.178499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] PATH_INFO: `/v3/users/a3a48c36adda4b6694f34943d1a974d8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:20.179983 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a48c36adda4b6694f34943d1a974d8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:20.182069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:20.477529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:20.491029 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a48c36adda4b6694f34943d1a974d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.491737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a48c36adda4b6694f34943d1a974d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.574878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a48c36adda4b6694f34943d1a974d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.583366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a48c36adda4b6694f34943d1a974d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.584161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c1c2800-cd7b-46ef-adea-291555500dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a48c36adda4b6694f34943d1a974d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:20.602511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1348/2694] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:20 2022] DELETE /identity/v3/users/a3a48c36adda4b6694f34943d1a974d8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:21.034974 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.035590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:21.049548 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332e49-653a-489d-b2fa-5e8e3c86009a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.106523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.107338 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.107638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.107910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] PATH_INFO: `/v3/projects/9447a1159cf345f48cb1266ff2244de1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.109082 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9447a1159cf345f48cb1266ff2244de1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.111534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.249505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9447a1159cf345f48cb1266ff2244de1', 'request_id': 'req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:21.316323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9447a1159cf345f48cb1266ff2244de1', 'request_id': 'req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:21.327746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9447a1159cf345f48cb1266ff2244de1', 'request_id': 'req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:21.338887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] The token cache is being invalidate because project 9447a1159cf345f48cb1266ff2244de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:21.339185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:21.339856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c8ddce6-e42f-4aa4-823e-10a5f13e6fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:21.344830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1347/2695] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:21 2022] DELETE /identity/v3/projects/9447a1159cf345f48cb1266ff2244de1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:21.345152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:21.346741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.347253 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.347566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.367357 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:21.368480 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:21.426244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1349/2696] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:38:21.430399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:21.434232 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.442601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.442601 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.460272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:21.461676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:21.471870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1348/2697] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:21.476343 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.486950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d179ad-5ca4-4da3-bb3a-d51e7f92dd42 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.492141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.492884 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.493177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.493456 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.494279 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:21.494596 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.496212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.508311 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1350/2698] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:38:21.512764 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.522187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff88688-4cc1-475c-a572-309615f8e25c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.526932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.527586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.527875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.528188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.528954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.530946 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.621401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1349/2699] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:21 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:38:21.625590 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.636903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915130c-62ab-4314-89f4-499442ab3e3a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.696838 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.697619 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.697910 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.698208 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.698991 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.701075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.819945 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1351/2700] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:21 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:21.824376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.835669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b094-d764-4d9f-826a-11f06968f240 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.840350 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.840973 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.841256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.841533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.842289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.844572 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.855023 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1350/2701] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:21.859398 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.869339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277db96-81da-42c4-ae15-af2f7b38367f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.873971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.874634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.874922 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.875202 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.875925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.877519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452003-4059-4fa9-af82-821521835f62 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:21.887869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1352/2702] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:21.892646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:21.902718 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af0b-ddcb-40ff-9727-da44a211b5d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:21.908592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:21.909636 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:21.909916 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:21.910227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] PATH_INFO: `/v3/projects/0b0e3e8e02dc49f8a25d0e357cd3a706/users/a6de29639ee24c7bbb5fe0d1d133daa4/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:21.926485 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0e3e8e02dc49f8a25d0e357cd3a706, user_id=a6de29639ee24c7bbb5fe0d1d133daa4, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:21.929266 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:22.037409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1351/2703] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:21 2022] PUT /identity/v3/projects/0b0e3e8e02dc49f8a25d0e357cd3a706/users/a6de29639ee24c7bbb5fe0d1d133daa4/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:22.049204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:22.049542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:22.049753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:22.076794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] MFA Rules not processed for user `a6de29639ee24c7bbb5fe0d1d133daa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:22.078562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:22.143794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1353/2704] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:22.156869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:22.162297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:22.235652 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a906bd-9a25-4c88-9059-51ccf07f67bc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:22.239335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:22.239989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:22.240281 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:22.240565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:22.264241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:22.264241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caa0b-b4b0-4ce9-b7f6-c6a4e166a635 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:22.264241 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1352/2705] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:22.282718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:22.350550 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5583-0f9e-4a8d-85cb-f42ce2b246c5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:22.355418 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:22.356330 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:22.356649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:22.356928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] PATH_INFO: `/v3/users/a6de29639ee24c7bbb5fe0d1d133daa4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:22.358299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6de29639ee24c7bbb5fe0d1d133daa4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:22.360341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:22.454809 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:22.638826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6de29639ee24c7bbb5fe0d1d133daa4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:22.639496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6de29639ee24c7bbb5fe0d1d133daa4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:22.926165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6de29639ee24c7bbb5fe0d1d133daa4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:22.935340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6de29639ee24c7bbb5fe0d1d133daa4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:22.936192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6de29639ee24c7bbb5fe0d1d133daa4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:22.956463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1354/2706] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:22 2022] DELETE /identity/v3/users/a6de29639ee24c7bbb5fe0d1d133daa4 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:22.961220 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:22.961855 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:22.961953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:22.980539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:22.981972 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:23.043881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1353/2707] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:23.053662 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:23.055172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:23.074152 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:23.113832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3775-0b39-4a01-87e9-d04329ac4637 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:23.122405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:23.122405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:23.122405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:23.122405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:23.129375 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:23.130895 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:23.143305 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1355/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:23.750626 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:23.752160 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:23.764834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568eeff-ff06-43d9-bb49-af73197a8225 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:23.770373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:23.774781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:23.774781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:23.774781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] PATH_INFO: `/v3/projects/0b0e3e8e02dc49f8a25d0e357cd3a706` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:23.774781 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0e3e8e02dc49f8a25d0e357cd3a706)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:23.775144 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:23.890669 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:23.905662 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0e3e8e02dc49f8a25d0e357cd3a706', 'request_id': 'req-a87392aa-bf53-4544-a34e-b8b7837dff88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:23.995617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0e3e8e02dc49f8a25d0e357cd3a706', 'request_id': 'req-a87392aa-bf53-4544-a34e-b8b7837dff88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:24.003775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0e3e8e02dc49f8a25d0e357cd3a706', 'request_id': 'req-a87392aa-bf53-4544-a34e-b8b7837dff88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:24.018597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] The token cache is being invalidate because project 0b0e3e8e02dc49f8a25d0e357cd3a706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:24.018894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:24.019554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a87392aa-bf53-4544-a34e-b8b7837dff88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:24.034224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1354/2709] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:23 2022] DELETE /identity/v3/projects/0b0e3e8e02dc49f8a25d0e357cd3a706 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:25.315701 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:25.316931 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:25.330243 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c20e-5685-4e8d-9f0f-7d688a10bd4e service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:25.384932 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:25.385784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:25.386063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:25.386366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] PATH_INFO: `/v3/users/3f5b8cf5bf3741f28d7db956626a15e3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:25.387556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5b8cf5bf3741f28d7db956626a15e3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:25.389535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:25.628373 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5b8cf5bf3741f28d7db956626a15e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:25.629205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5b8cf5bf3741f28d7db956626a15e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:25.681816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5b8cf5bf3741f28d7db956626a15e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:25.689981 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5b8cf5bf3741f28d7db956626a15e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:25.690654 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5b8cf5bf3741f28d7db956626a15e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:25.708459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1356/2710] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:25 2022] DELETE /identity/v3/users/3f5b8cf5bf3741f28d7db956626a15e3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:25.713083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:25.713564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:25.713680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:25.731880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:25.733099 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:25.793309 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1355/2711] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:25.803616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:25.807678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:25.848908 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:25.864182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062f55-7a56-4f16-b564-b3f792c4a77c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:25.867800 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:25.868451 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:25.868775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:25.869052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:25.878564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:25.880034 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:25.889832 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1357/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:26.068457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:26.070042 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:26.083187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41e093-4fe4-47a5-8028-4930a0288d9c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:26.088549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:26.089441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:26.089891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:26.090314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] PATH_INFO: `/v3/users/4250561a249a4a1581c3ddfb6cd1b3fc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:26.091544 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4250561a249a4a1581c3ddfb6cd1b3fc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:26.093553 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:26.330389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4250561a249a4a1581c3ddfb6cd1b3fc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.330953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4250561a249a4a1581c3ddfb6cd1b3fc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.331575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4250561a249a4a1581c3ddfb6cd1b3fc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.343322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4250561a249a4a1581c3ddfb6cd1b3fc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.353775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:26.355409 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:26.370636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa8db9-ae9f-4e45-8577-7d5bbf72c0a3 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:26.375956 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:26.376816 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:26.377201 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:26.377378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] PATH_INFO: `/v3/projects/3fc602912c9d4156b0427fff8dac8c5c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:26.378960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc602912c9d4156b0427fff8dac8c5c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:26.380971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:26.437135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a521d874-48e5-47b6-acb0-2caca04725e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4250561a249a4a1581c3ddfb6cd1b3fc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.451900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1356/2713] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:26 2022] DELETE /identity/v3/users/4250561a249a4a1581c3ddfb6cd1b3fc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:26.456423 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:26.456722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:26.457005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:26.475787 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:26.477071 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:26.484770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc602912c9d4156b0427fff8dac8c5c', 'request_id': 'req-1a07c9fe-f915-4fd4-be0d-8c776b722bac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.501993 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:26.537465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1357/2714] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:38:26.547979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:26.549324 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:26.568182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc602912c9d4156b0427fff8dac8c5c', 'request_id': 'req-1a07c9fe-f915-4fd4-be0d-8c776b722bac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.574978 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc602912c9d4156b0427fff8dac8c5c', 'request_id': 'req-1a07c9fe-f915-4fd4-be0d-8c776b722bac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.588526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] The token cache is being invalidate because project 3fc602912c9d4156b0427fff8dac8c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:26.588526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.588526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:26.589796 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1358/2715] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:26 2022] DELETE /identity/v3/projects/3fc602912c9d4156b0427fff8dac8c5c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:26.611311 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e984f0-ad39-450b-bb5a-3e605a83ba60 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:26.615457 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:26.616141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:26.616433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:26.616719 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:26.618860 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:26.633880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:26.635571 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d791d07-1eeb-46bb-b1e8-0d7a82451811 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:26.646882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1358/2716] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:27.110050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:27.113588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:27.125514 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c9fe-f915-4fd4-be0d-8c776b722bac admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:27.131417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:27.132368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.132653 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.132958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] PATH_INFO: `/v3/projects/260838b8e8264aa39e8f21dd6ebe9c5b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.134220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] RBAC: Authorizing `identity:delete_project(project_id=260838b8e8264aa39e8f21dd6ebe9c5b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:27.136184 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:27.312891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260838b8e8264aa39e8f21dd6ebe9c5b', 'request_id': 'req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:27.419742 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260838b8e8264aa39e8f21dd6ebe9c5b', 'request_id': 'req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:27.427082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260838b8e8264aa39e8f21dd6ebe9c5b', 'request_id': 'req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:27.438676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] The token cache is being invalidate because project 260838b8e8264aa39e8f21dd6ebe9c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:27.438980 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:27.439635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ccc14ae-e6e6-4627-aa14-d60b6a24557c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:27.441220 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1359/2717] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:27 2022] DELETE /identity/v3/projects/260838b8e8264aa39e8f21dd6ebe9c5b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:27.446218 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.451877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.451877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.467045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:27.468424 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:27.534607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1359/2718] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:38:27.553569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.553569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.553569 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.562934 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:27.564153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:27.572069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1360/2719] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:27.576416 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:27.586924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb585e-ef15-41ce-9985-41617be7ef10 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:27.591590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:27.592256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.593935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.593935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.593935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:38:27.594260 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:27.595628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:27.607319 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1360/2720] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:38:27.611828 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:27.621261 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4664e3-b7e7-4380-853d-ae678b85e2ef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:27.627040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:27.628214 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.628331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.628508 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.629210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:27.631205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:27.829757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1361/2721] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:27.834679 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:27.843320 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9749-5e89-4f95-b434-62db6623f504 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:27.904449 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:27.905408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:27.905696 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:27.906009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:27.906753 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:27.908754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:27.915582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:27.982001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:27.983807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:27.997582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac980-bd0b-4520-a331-11d550c0800d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.007224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.008112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.011665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.011665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] PATH_INFO: `/v3/users/05506c35ed2744979aceaceaad15c6f0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.011665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05506c35ed2744979aceaceaad15c6f0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.011952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1361/2722] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:27 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:28.012269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.014628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.025228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3b2a-0208-43e7-abaa-54b30167c98e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.026613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:28.030323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.034568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.034568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.034568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.034568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.034568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.045226 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1362/2723] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:28.049739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.059378 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfff-4478-4288-93ca-52c50e6673c4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.064941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.065602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.065887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.066163 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.066918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.068514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.078979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1363/2724] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:38:28.083012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.093188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8041-5768-4771-8506-eb04baaa3b7d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.098064 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.103396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.103396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.103396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] PATH_INFO: `/v3/projects/dc12a1416b6c4827a8c5f56ea9dd6b05/users/17284561d44848c1b6fb8dff08e02c14/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.115440 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc12a1416b6c4827a8c5f56ea9dd6b05, user_id=17284561d44848c1b6fb8dff08e02c14, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.118100 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339778-5f91-4569-b584-b90876be5575 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.197922 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1364/2725] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:28 2022] PUT /identity/v3/projects/dc12a1416b6c4827a8c5f56ea9dd6b05/users/17284561d44848c1b6fb8dff08e02c14/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:28.209133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.209421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.209710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.242089 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05506c35ed2744979aceaceaad15c6f0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:28.242864 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05506c35ed2744979aceaceaad15c6f0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:28.259388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] MFA Rules not processed for user `17284561d44848c1b6fb8dff08e02c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:28.259388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.352229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1365/2726] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:28.353001 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.354379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.411845 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05506c35ed2744979aceaceaad15c6f0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:28.420170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05506c35ed2744979aceaceaad15c6f0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:28.422399 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05506c35ed2744979aceaceaad15c6f0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:28.434864 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fc498-01ae-48f7-9fe9-e9a140ad4462 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.441055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.442344 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.442880 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.442998 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1362/2727] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:27 2022] DELETE /identity/v3/users/05506c35ed2744979aceaceaad15c6f0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:28.443123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.443880 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.444838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.445126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.458599 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.460484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901fb05-275c-4558-9409-db2770e854dc service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.472858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1366/2728] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:28.474025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.474389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.474707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.514016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:28.515556 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.534284 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:28.540058 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ffd9-d871-4cf4-b78d-6643a582f32c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.545645 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.547176 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.547648 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.548258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.549266 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.551417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.596186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1367/2729] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:28.604452 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.606782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:28.677038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1363/2730] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:38:28 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:28.678655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcaa75-8d7e-41fc-9c70-7604cc5fe40c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.680990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.746714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.747558 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.747854 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.748192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.821789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfbd7e-9e18-4fcf-8b6a-f053bb30ab2c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.826973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.827844 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.828132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.828411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.829182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.831333 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.839420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.840315 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.853518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1368/2731] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:28.946824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1364/2732] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:38:28 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:38:28.963401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:28.977801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aed50-e441-4b2b-876d-5d291ae31ca9 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:28.982734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:28.983499 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:28.983790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:28.984657 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:28.985401 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:28.987067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:28.998062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1369/2733] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:29.002487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.009436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:29.014818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964bb9-0307-4482-a2b9-0afa11630a90 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.019610 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.020519 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.020804 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.021082 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] PATH_INFO: `/v3/projects/5754ae2a969947b0a1d8bfeef23388a6/users/e2f1ac250c054faca3c36bedcc5c7289/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.038909 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5754ae2a969947b0a1d8bfeef23388a6, user_id=e2f1ac250c054faca3c36bedcc5c7289, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.041690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.114063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1365/2734] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:29 2022] PUT /identity/v3/projects/5754ae2a969947b0a1d8bfeef23388a6/users/e2f1ac250c054faca3c36bedcc5c7289/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:29.117446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.129923 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390647b0-7686-4ac4-a9ad-7be22a21499a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.145942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:29.203072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.203891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.204177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.204778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.205183 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.212008 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26ad25-8b2d-48ee-8841-3823c1a19046 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.227444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1370/2735] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:38:29.231694 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.243826 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63042b18-8d89-485a-9a3b-6acd89919dbd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.248771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.249741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.250024 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.250338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] PATH_INFO: `/v3/projects/5754ae2a969947b0a1d8bfeef23388a6/users/e2f1ac250c054faca3c36bedcc5c7289/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.253727 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5754ae2a969947b0a1d8bfeef23388a6, user_id=e2f1ac250c054faca3c36bedcc5c7289, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.257658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.268535 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1366/2736] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:38:29 2022] PUT /identity/v3/projects/5754ae2a969947b0a1d8bfeef23388a6/users/e2f1ac250c054faca3c36bedcc5c7289/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:38:29.279236 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.279560 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.279842 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.307821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] MFA Rules not processed for user `e2f1ac250c054faca3c36bedcc5c7289`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:38:29.309040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:29.381691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1371/2737] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:38:29.395690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.397901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:29.413941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.415671 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:29.462542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c18b-e452-4bb2-9667-77c3aae548c9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.466938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.467628 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.467912 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.469250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.478320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.479860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.487425 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca858840-b495-4b32-b00b-6b7bb238ba02 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.489622 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1367/2738] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:29.492917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.493828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.494111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.494515 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] PATH_INFO: `/v3/projects/b5e4ed6911ee482cbe4dbaad2b88292e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.495618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e4ed6911ee482cbe4dbaad2b88292e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.498650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.652661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:29.661272 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e4ed6911ee482cbe4dbaad2b88292e', 'request_id': 'req-9fca83e5-210a-4418-b3e3-07e50963d10d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:29.802581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e4ed6911ee482cbe4dbaad2b88292e', 'request_id': 'req-9fca83e5-210a-4418-b3e3-07e50963d10d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:29.808870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e4ed6911ee482cbe4dbaad2b88292e', 'request_id': 'req-9fca83e5-210a-4418-b3e3-07e50963d10d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:29.823532 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] The token cache is being invalidate because project b5e4ed6911ee482cbe4dbaad2b88292e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:29.823834 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:29.824165 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.824740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:29.826533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1372/2739] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:29 2022] DELETE /identity/v3/projects/b5e4ed6911ee482cbe4dbaad2b88292e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:29.834097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c48b9f-fd84-4f75-bf97-e8a8168783fe service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:29.891979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:29.892481 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:29.892769 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:29.893075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:29.896306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:29.967739 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:29.970362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:29.974063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:29.975789 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:29.988588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1368/2740] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:30.000003 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:30.001857 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:30.055785 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:30.074942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca83e5-210a-4418-b3e3-07e50963d10d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:30.084546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:30.085257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:30.086002 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:30.086353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:30.088606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:30.097851 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b9e5-141d-4ecb-af36-a91ca09c1228 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:30.102101 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:30.102996 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:30.103457 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:30.103886 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:30.105878 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:30.159016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:30.160588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:30.170036 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1373/2741] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 09:38:30.176328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:30.183045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:30.190713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1369/2742] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:32.901126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:32.911374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3039b-83c6-46ea-817f-b7c0a8e024cd service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:32.917914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:32.918621 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:32.918906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:32.919185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:32.921162 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:32.987910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:32.990156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:32.991648 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:33.001808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1374/2743] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:38:40.311265 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=37 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:40.472095 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:40.472475 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:40.489254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8165-32ff-42df-8c20-268a8fc6cbd9 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:40.494404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:40.495316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:40.495603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:40.495881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] PATH_INFO: `/v3/users/35ea430cfcbc4236af2be83ffcde77fb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:40.497145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ea430cfcbc4236af2be83ffcde77fb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:40.502410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:40.759632 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ea430cfcbc4236af2be83ffcde77fb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:40.760323 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ea430cfcbc4236af2be83ffcde77fb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:40.847378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ea430cfcbc4236af2be83ffcde77fb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:40.855066 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ea430cfcbc4236af2be83ffcde77fb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:40.855705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ea430cfcbc4236af2be83ffcde77fb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:40.873911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1370/2744] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:40 2022] DELETE /identity/v3/users/35ea430cfcbc4236af2be83ffcde77fb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:41.123564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:41.134517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74898f-35c4-4fa6-a604-cb66645d1f27 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:41.196540 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:41.197551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:41.197845 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:41.198114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] PATH_INFO: `/v3/projects/38a70cde2f54464ab0e97b1218489870` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:41.199353 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a70cde2f54464ab0e97b1218489870)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:41.201271 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:41.321948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a70cde2f54464ab0e97b1218489870', 'request_id': 'req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.402083 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a70cde2f54464ab0e97b1218489870', 'request_id': 'req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.408838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a70cde2f54464ab0e97b1218489870', 'request_id': 'req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.420201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] The token cache is being invalidate because project 38a70cde2f54464ab0e97b1218489870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:41.420491 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.421135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.422746 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1375/2745] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:41 2022] DELETE /identity/v3/projects/38a70cde2f54464ab0e97b1218489870 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:41.426797 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:41.428283 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:41.441462 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d78-67ec-4144-b5a0-819207c82c88 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:41.498212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:41.499092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:41.499381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:41.499682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] PATH_INFO: `/v3/users/c36a3854e97344a095a7ca7bc189821e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:41.500920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36a3854e97344a095a7ca7bc189821e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:41.502899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:41.690860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36a3854e97344a095a7ca7bc189821e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.691493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36a3854e97344a095a7ca7bc189821e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.765856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36a3854e97344a095a7ca7bc189821e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.773821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36a3854e97344a095a7ca7bc189821e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.774498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36a3854e97344a095a7ca7bc189821e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:41.782236 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:41.791877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1371/2746] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:38:41 2022] DELETE /identity/v3/users/c36a3854e97344a095a7ca7bc189821e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:42.043484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:38:42.045157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:38:42.059095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8c714-1619-4762-aa7b-e32ecdd4d59f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:38:42.127792 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:38:42.128932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:38:42.129197 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:38:42.129478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] PATH_INFO: `/v3/projects/83a61633df19496e9ed36e91fe0b1f66` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:38:42.130772 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a61633df19496e9ed36e91fe0b1f66)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:38:42.132713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:38:42.221815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:42.237336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a61633df19496e9ed36e91fe0b1f66', 'request_id': 'req-4a20075a-a1da-40e0-829f-bab631105e26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:42.309106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a61633df19496e9ed36e91fe0b1f66', 'request_id': 'req-4a20075a-a1da-40e0-829f-bab631105e26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:42.315740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a61633df19496e9ed36e91fe0b1f66', 'request_id': 'req-4a20075a-a1da-40e0-829f-bab631105e26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:42.326825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] The token cache is being invalidate because project 83a61633df19496e9ed36e91fe0b1f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:38:42.327118 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:42.327760 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4a20075a-a1da-40e0-829f-bab631105e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:38:42.329342 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1376/2747] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:38:42 2022] DELETE /identity/v3/projects/83a61633df19496e9ed36e91fe0b1f66 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:38:52.121598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:38:52.447741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:05.536444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:05.537929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:05.551310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24358-036a-43b8-a0e1-bbcc8f96b50d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:05.606551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:05.607349 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:05.607738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:05.607982 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] PATH_INFO: `/v3/users/17284561d44848c1b6fb8dff08e02c14` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:05.609309 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17284561d44848c1b6fb8dff08e02c14)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:05.611334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:05.784942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17284561d44848c1b6fb8dff08e02c14'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:05.785897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17284561d44848c1b6fb8dff08e02c14'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:05.868205 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17284561d44848c1b6fb8dff08e02c14'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:05.875621 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17284561d44848c1b6fb8dff08e02c14'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:05.879641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17284561d44848c1b6fb8dff08e02c14'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:05.893666 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1372/2748] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:05 2022] DELETE /identity/v3/users/17284561d44848c1b6fb8dff08e02c14 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:05.898865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:05.899431 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:05.899551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:05.917631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:05.918891 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:05.978111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1377/2749] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:05.987805 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:05.989222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:06.047643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec062-ea86-4aa6-a0a4-56a586461828 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:06.051696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:06.052358 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:06.052641 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:06.052917 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:06.063060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:06.064492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:06.074141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1373/2750] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:06.529502 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:06.531047 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:06.543500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9cf6a-b6a6-4656-a422-eaff5bdd8c1d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:06.548365 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:06.549237 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:06.549529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:06.549802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] PATH_INFO: `/v3/projects/dc12a1416b6c4827a8c5f56ea9dd6b05` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:06.551024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc12a1416b6c4827a8c5f56ea9dd6b05)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:06.553161 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:06.649287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc12a1416b6c4827a8c5f56ea9dd6b05', 'request_id': 'req-9b7c696d-bf61-43b2-a2a0-6debec4a7274'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:06.710114 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc12a1416b6c4827a8c5f56ea9dd6b05', 'request_id': 'req-9b7c696d-bf61-43b2-a2a0-6debec4a7274'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:06.716300 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc12a1416b6c4827a8c5f56ea9dd6b05', 'request_id': 'req-9b7c696d-bf61-43b2-a2a0-6debec4a7274'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:06.727336 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] The token cache is being invalidate because project dc12a1416b6c4827a8c5f56ea9dd6b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:06.727624 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:06.728252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:06.729797 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1378/2751] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:06 2022] DELETE /identity/v3/projects/dc12a1416b6c4827a8c5f56ea9dd6b05 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:06.733930 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:06.744454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d228e-9f4a-4572-b312-1cffd9d6ae06 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:06.763210 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:06.801440 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:06.802258 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:06.802552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:06.802829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] PATH_INFO: `/v3/users/e2f1ac250c054faca3c36bedcc5c7289` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:06.804583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f1ac250c054faca3c36bedcc5c7289)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:06.806592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:07.033128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f1ac250c054faca3c36bedcc5c7289'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.033793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f1ac250c054faca3c36bedcc5c7289'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.121779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f1ac250c054faca3c36bedcc5c7289'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.129901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f1ac250c054faca3c36bedcc5c7289'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.130635 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e997bd5-b09c-4403-b836-e30a82c79bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f1ac250c054faca3c36bedcc5c7289'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.149690 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1374/2752] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:06 2022] DELETE /identity/v3/users/e2f1ac250c054faca3c36bedcc5c7289 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:07.557887 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:07.559455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:07.573588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c696d-bf61-43b2-a2a0-6debec4a7274 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:07.631005 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:07.631876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:07.632166 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:07.632447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] PATH_INFO: `/v3/projects/5754ae2a969947b0a1d8bfeef23388a6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:07.634346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5754ae2a969947b0a1d8bfeef23388a6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:07.636268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:07.740562 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:07.757756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5754ae2a969947b0a1d8bfeef23388a6', 'request_id': 'req-9f079832-f89d-46d7-bcf2-85daa74e91f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.882010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5754ae2a969947b0a1d8bfeef23388a6', 'request_id': 'req-9f079832-f89d-46d7-bcf2-85daa74e91f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.888253 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5754ae2a969947b0a1d8bfeef23388a6', 'request_id': 'req-9f079832-f89d-46d7-bcf2-85daa74e91f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.899408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] The token cache is being invalidate because project 5754ae2a969947b0a1d8bfeef23388a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:07.899698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.900335 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9f079832-f89d-46d7-bcf2-85daa74e91f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:07.901875 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1379/2753] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:07 2022] DELETE /identity/v3/projects/5754ae2a969947b0a1d8bfeef23388a6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:07.906899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:07.907396 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:07.907510 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:07.925167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:07.926423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:07.987153 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1375/2754] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:07.995851 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:07.996063 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:07.996341 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.015952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:08.018359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:08.025615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1380/2755] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:08.029861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.040361 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0977-c08f-481b-a4e6-bcde3a198b3f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.045055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.045721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.046045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.046365 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.047100 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:39:08.047415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.049083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.061450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1376/2756] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:39:08.065771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.075598 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74f08b-42e3-4d34-8380-d508c9f6978f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.080830 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.081487 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.081775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.082055 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.082799 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.084707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.196216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1381/2757] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:39:08.200643 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.211683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfaacb-fd0d-4be1-bb04-cb8e49d3518a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.238791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:08.268894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.269496 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.269784 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.270063 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.270781 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.272748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.327802 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1377/2758] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:08 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:08.331928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.342962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20718-b0c0-4c85-b199-955f9073eae4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.347918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.348585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.348904 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.349186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.349918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.352215 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.362953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1382/2759] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:08.367042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.377126 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f39e-1b1d-4adc-9ef5-a32fc4f47553 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.382092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.382830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.383120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.383404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.384174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.385775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc2378-b5e8-400b-8803-e47f2fc786db admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.395848 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1378/2760] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:08.400685 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.411881 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6402f-4f32-430b-aa93-1761d1b36d89 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.417402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.418359 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.418649 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.418929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] PATH_INFO: `/v3/projects/fdc0ebfa710241f69c0959a3a252d286/users/f7584bf7acf341d6927649e09d0bcf07/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.434289 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc0ebfa710241f69c0959a3a252d286, user_id=f7584bf7acf341d6927649e09d0bcf07, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.436991 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.502952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1383/2761] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:08 2022] PUT /identity/v3/projects/fdc0ebfa710241f69c0959a3a252d286/users/f7584bf7acf341d6927649e09d0bcf07/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:08.515226 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.515523 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.515808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.544623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] MFA Rules not processed for user `f7584bf7acf341d6927649e09d0bcf07`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:08.545728 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:08.610306 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1379/2762] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:08.614899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.680318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0624d6-9336-40c1-a403-679a3b504196 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.685073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.685735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.686026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.686346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.687040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.688956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.795574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1384/2763] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:08 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:08.799722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.810824 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a292f3-8f85-4248-b607-cfd467c4b4dd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.868489 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.869185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.869469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.869747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.870463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.872377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:08.973172 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1380/2764] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:08 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:39:08.977348 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:08.987805 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275d48c-dfe3-44e1-ab28-36b0c99fabe0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:08.992943 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:08.993608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:08.993900 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:08.994185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:08.994941 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:08.996563 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:09.009164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1385/2765] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:09.013484 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:09.024087 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291162a9-33ae-422e-b037-906261c5d4e6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:09.028971 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:09.029856 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:09.030145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:09.030469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] PATH_INFO: `/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b/users/100bdc2e5ca14d8dabcef17131501072/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:09.045915 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=045925a3f5ff43c3beecd08d1e8dec4b, user_id=100bdc2e5ca14d8dabcef17131501072, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:09.048571 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:09.123006 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1381/2766] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:09 2022] PUT /identity/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b/users/100bdc2e5ca14d8dabcef17131501072/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:09.126996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:09.137985 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50694c9-5d97-4109-8079-e90aae1c8945 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:09.158113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:09.196955 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:09.197629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:09.197917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:09.198228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:09.198971 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:09.200586 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8733b8-9e31-4dbc-93b8-a5b0513abbb7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:09.211533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1386/2767] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:09.216164 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:09.221710 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:09.227780 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28208a-e246-45d0-91ec-4d6a01419d3a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:09.232589 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:09.233482 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:09.233897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:09.234715 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] PATH_INFO: `/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b/users/100bdc2e5ca14d8dabcef17131501072/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:09.236340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045925a3f5ff43c3beecd08d1e8dec4b, user_id=100bdc2e5ca14d8dabcef17131501072, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:09.239038 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:09.250250 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1382/2768] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:09 2022] PUT /identity/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b/users/100bdc2e5ca14d8dabcef17131501072/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:09.262184 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:09.262518 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:09.262837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:09.290317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] MFA Rules not processed for user `100bdc2e5ca14d8dabcef17131501072`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:09.291568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:09.359765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1387/2769] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:09.372316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:09.374045 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:09.432406 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335388f-deaf-47d3-a145-c0a27a4e09a5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:09.436300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:09.436938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:09.437221 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:09.437499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:09.447204 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:09.448668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5969d-a4df-4d89-9a20-262034d31af0 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:09.458378 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1383/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:10.517238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:10.581115 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0d7f4-a739-4c1b-83dc-a4b41617485c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:10.586473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:10.587554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:10.587953 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:10.588585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] PATH_INFO: `/v3/users/f7584bf7acf341d6927649e09d0bcf07` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:10.590052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7584bf7acf341d6927649e09d0bcf07)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:10.592228 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:10.747911 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7584bf7acf341d6927649e09d0bcf07'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:10.748577 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7584bf7acf341d6927649e09d0bcf07'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:10.749435 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7584bf7acf341d6927649e09d0bcf07'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:10.750721 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:10.762585 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7584bf7acf341d6927649e09d0bcf07'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:10.836859 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7584bf7acf341d6927649e09d0bcf07'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:10.849477 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1388/2771] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:10 2022] DELETE /identity/v3/users/f7584bf7acf341d6927649e09d0bcf07 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:10.855669 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:10.856200 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:10.856476 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:10.875149 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:10.876353 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:10.936316 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1384/2772] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:10.946106 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:10.947591 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:11.006251 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe50d-9ed4-4c37-846a-0059064f76b5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:11.009874 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:11.010557 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:11.010884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:11.011169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:11.020327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:11.021767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:11.031327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1389/2773] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:11.440975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:11.442429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:11.455913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a30013-b18d-4ece-a9e4-ecae6a207554 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:11.462493 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:11.463433 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:11.463725 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:11.464010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] PATH_INFO: `/v3/projects/fdc0ebfa710241f69c0959a3a252d286` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:11.465257 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc0ebfa710241f69c0959a3a252d286)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:11.467251 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:11.611023 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc0ebfa710241f69c0959a3a252d286', 'request_id': 'req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:11.679439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc0ebfa710241f69c0959a3a252d286', 'request_id': 'req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:11.686238 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc0ebfa710241f69c0959a3a252d286', 'request_id': 'req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:11.701310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] The token cache is being invalidate because project fdc0ebfa710241f69c0959a3a252d286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:11.701310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:11.701310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:11.701310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1385/2774] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:11 2022] DELETE /identity/v3/projects/fdc0ebfa710241f69c0959a3a252d286 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:39:11.703901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:11.714351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87968e4c-efa0-4b8b-9640-0331039c0239 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:11.770312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:11.771190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:11.771481 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:11.771767 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] PATH_INFO: `/v3/users/100bdc2e5ca14d8dabcef17131501072` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:11.772960 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=100bdc2e5ca14d8dabcef17131501072)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:11.775504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:12.002498 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100bdc2e5ca14d8dabcef17131501072'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.003153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100bdc2e5ca14d8dabcef17131501072'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.004104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100bdc2e5ca14d8dabcef17131501072'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.016840 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100bdc2e5ca14d8dabcef17131501072'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.020523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:12.079589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b8f8e81e-4580-4304-b3b7-bde8428909fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100bdc2e5ca14d8dabcef17131501072'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.092590 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1390/2775] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:11 2022] DELETE /identity/v3/users/100bdc2e5ca14d8dabcef17131501072 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:12.478069 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:12.480182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:12.496825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb9eb-9657-445e-a1df-a9b6d7d85414 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:12.510224 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:12.563222 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:12.564042 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:12.564327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:12.564602 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] PATH_INFO: `/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:12.565794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045925a3f5ff43c3beecd08d1e8dec4b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:12.567773 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:12.704787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045925a3f5ff43c3beecd08d1e8dec4b', 'request_id': 'req-db3443ad-1e19-4f74-ac71-272490876050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.790748 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045925a3f5ff43c3beecd08d1e8dec4b', 'request_id': 'req-db3443ad-1e19-4f74-ac71-272490876050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.797976 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045925a3f5ff43c3beecd08d1e8dec4b', 'request_id': 'req-db3443ad-1e19-4f74-ac71-272490876050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.809247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] The token cache is being invalidate because project 045925a3f5ff43c3beecd08d1e8dec4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:12.809582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.810292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-db3443ad-1e19-4f74-ac71-272490876050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:12.812039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1386/2776] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:12 2022] DELETE /identity/v3/projects/045925a3f5ff43c3beecd08d1e8dec4b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:39:12.816952 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:12.817530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:12.817530 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:12.839668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:12.840878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:12.904439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1391/2777] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:12.912554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:12.912847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:12.913125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:12.932439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:12.938754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:12.941818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1387/2778] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:12.946754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:12.956928 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce42a-39a8-49d0-90ef-096c8c079bc1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:12.962837 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:12.963514 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:12.963802 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:12.964089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:12.964825 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:39:12.965137 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:12.966827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:12.980025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1392/2779] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:39:12.984377 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:12.994726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6885d0c-797d-4816-90d9-a769aeafbff9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:12.999634 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.000301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.000592 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.000902 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.001609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.003823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.116726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1388/2780] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:12 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:13.121238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.131771 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687863-7f76-4cfd-8da7-dd624c1f7504 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.192815 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.193735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.193863 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.194090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.194843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.196905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.396995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1393/2781] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:13 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:39:13.400651 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.411328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154b446-db78-4f07-9600-ee2df253975b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.416683 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.417393 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.417674 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.417951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.418746 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.420339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.431730 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1389/2782] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:13.438691 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.449025 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f5a1a-157b-496a-8d0a-014c4f1e866b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.453774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.454484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.454775 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.455086 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.455817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.457512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8f278-4125-4241-81c9-7974a18ddb30 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.470027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1394/2783] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:13.474131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.484498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e3bb-e338-4d99-8df0-29a237b5389e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.489420 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.490411 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.490640 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.490920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] PATH_INFO: `/v3/projects/cf2e113a622f4a02b091ce4181a99d39/users/6ce51ed280f846f88e3a78a1e16bf5fe/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.508757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2e113a622f4a02b091ce4181a99d39, user_id=6ce51ed280f846f88e3a78a1e16bf5fe, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.511487 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.600133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1390/2784] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:13 2022] PUT /identity/v3/projects/cf2e113a622f4a02b091ce4181a99d39/users/6ce51ed280f846f88e3a78a1e16bf5fe/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:13.611597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.611899 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.612224 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.643520 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] MFA Rules not processed for user `6ce51ed280f846f88e3a78a1e16bf5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:13.644748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:13.689135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:13.712245 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1395/2785] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:13.716925 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.763775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:13.781951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80b3a-b74d-4610-a686-6fa1ea02ccb1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.787273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.787940 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.788254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.788561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.789770 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:13.792663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:13.919298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1391/2786] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:13 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:13.923734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:13.935389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdfb35-b7c2-42ed-abf6-54a83974b6ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:13.996905 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:13.997584 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:13.997873 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:13.998157 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:13.998894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.000831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.120396 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1396/2787] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:13 2022] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:14.124438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.135273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df2f-cecf-4649-9d7a-9c947f6269c8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.139911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.140568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.140855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.141133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.141855 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.143560 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.155436 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1392/2788] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:14.159689 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.171261 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312bd87-7985-462a-a428-bf0d3a38bb2b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.176227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.177130 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.177448 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.177729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] PATH_INFO: `/v3/projects/6b8a1882567f4359be2e7d490a1521d8/users/ee9c41147ea54ac88b0b9c665b0a2b13/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.194252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8a1882567f4359be2e7d490a1521d8, user_id=ee9c41147ea54ac88b0b9c665b0a2b13, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.196996 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.263980 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1397/2789] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:14 2022] PUT /identity/v3/projects/6b8a1882567f4359be2e7d490a1521d8/users/ee9c41147ea54ac88b0b9c665b0a2b13/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:39:14.268174 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.278661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192723-d581-47dd-9539-67327f2f73b2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.337356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.338021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.338340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.338624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.339352 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.340953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818849d9-7856-4850-841e-366ac49e5e4b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.350830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1393/2790] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:14.355187 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.367604 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9162f-bc45-4971-84b4-d155512c120f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.372476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.373388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.373684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.373968 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] PATH_INFO: `/v3/projects/6b8a1882567f4359be2e7d490a1521d8/users/ee9c41147ea54ac88b0b9c665b0a2b13/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.376325 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8a1882567f4359be2e7d490a1521d8, user_id=ee9c41147ea54ac88b0b9c665b0a2b13, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.379270 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.390785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1398/2791] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:14 2022] PUT /identity/v3/projects/6b8a1882567f4359be2e7d490a1521d8/users/ee9c41147ea54ac88b0b9c665b0a2b13/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:39:14.401792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.402088 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.402404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.429647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] MFA Rules not processed for user `ee9c41147ea54ac88b0b9c665b0a2b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:14.430900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:14.498247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1394/2792] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:14.509826 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.511531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:14.569534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594641d0-11c9-4d7e-9945-03b7cdbf0e81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.573694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.574400 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.574693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.574979 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.584199 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.586306 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.595804 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1399/2793] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:14.641667 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:14.643118 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:14.656192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78fa15-2d9f-4fcc-ab35-ca7e7ed08293 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:14.659923 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:14.660573 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:14.660860 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:14.661141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:14.694582 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:14.718578 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:14.720056 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:14.729157 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1395/2794] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:15.866841 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:15.868323 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:15.912060 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:15.939141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107e6d2-d9b4-4134-801f-c43a1a331aec service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:15.944136 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:15.945302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:15.945602 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:15.945886 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:15.947726 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:15.960096 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:15.965641 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cf1a-83ff-4d3c-8015-3c6624e087f7 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:15.972770 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1400/2795] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:19.516733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:19.578711 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806356-f4d2-4f16-9afd-e731ddf64955 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:19.583246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:19.584107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:19.584394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:19.584672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] PATH_INFO: `/v3/users/6ce51ed280f846f88e3a78a1e16bf5fe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:19.585854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce51ed280f846f88e3a78a1e16bf5fe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:19.588460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:19.796698 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce51ed280f846f88e3a78a1e16bf5fe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:19.797334 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce51ed280f846f88e3a78a1e16bf5fe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:19.861834 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce51ed280f846f88e3a78a1e16bf5fe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:19.869383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce51ed280f846f88e3a78a1e16bf5fe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:19.870027 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce51ed280f846f88e3a78a1e16bf5fe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:19.888055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1396/2796] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:19 2022] DELETE /identity/v3/users/6ce51ed280f846f88e3a78a1e16bf5fe => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:19.892597 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:19.893085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:19.893186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:19.910912 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:19.912131 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:19.970631 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1401/2797] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:19.980346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:19.981840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:20.038795 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef964f5-8d9b-496c-a3ef-ea22d0bfb6bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:20.042460 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:20.043107 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:20.043397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:20.043678 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:20.052765 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:20.054141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:20.058618 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:20.064871 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1397/2798] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:20.583782 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:20.585230 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:20.599433 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff24d7-7af4-423c-b0ee-dcc81aba3e9d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:20.604731 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:20.605608 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:20.605896 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:20.606179 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] PATH_INFO: `/v3/projects/cf2e113a622f4a02b091ce4181a99d39` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:20.607427 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2e113a622f4a02b091ce4181a99d39)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:20.610126 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:20.757185 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2e113a622f4a02b091ce4181a99d39', 'request_id': 'req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:20.816293 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2e113a622f4a02b091ce4181a99d39', 'request_id': 'req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:20.822512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2e113a622f4a02b091ce4181a99d39', 'request_id': 'req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:20.833643 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] The token cache is being invalidate because project cf2e113a622f4a02b091ce4181a99d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:20.833929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:20.834580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:20.836710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1402/2799] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:20 2022] DELETE /identity/v3/projects/cf2e113a622f4a02b091ce4181a99d39 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:20.841159 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:20.851044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f51d-3934-469f-95fd-4bbdaa5107e6 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:20.908877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:20.909752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:20.910041 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:20.910363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] PATH_INFO: `/v3/users/ee9c41147ea54ac88b0b9c665b0a2b13` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:20.911563 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9c41147ea54ac88b0b9c665b0a2b13)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:20.913566 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:21.107821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9c41147ea54ac88b0b9c665b0a2b13'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.108408 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9c41147ea54ac88b0b9c665b0a2b13'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.196449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9c41147ea54ac88b0b9c665b0a2b13'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.203779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9c41147ea54ac88b0b9c665b0a2b13'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.204415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e600fe5-c153-49d6-aa80-5d055d4eff45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9c41147ea54ac88b0b9c665b0a2b13'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.223859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1398/2800] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:20 2022] DELETE /identity/v3/users/ee9c41147ea54ac88b0b9c665b0a2b13 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:21.660622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:21.662151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:21.676177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7c4f3-4a72-4878-b4f7-e1277f6e0736 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:21.725207 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:21.735209 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:21.736933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:21.736933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:21.736933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] PATH_INFO: `/v3/projects/6b8a1882567f4359be2e7d490a1521d8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:21.737978 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8a1882567f4359be2e7d490a1521d8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:21.739989 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:21.871339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8a1882567f4359be2e7d490a1521d8', 'request_id': 'req-5c1a51f4-e8a2-4b23-8e4f-691522402347'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.944872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8a1882567f4359be2e7d490a1521d8', 'request_id': 'req-5c1a51f4-e8a2-4b23-8e4f-691522402347'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.950983 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8a1882567f4359be2e7d490a1521d8', 'request_id': 'req-5c1a51f4-e8a2-4b23-8e4f-691522402347'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.962352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] The token cache is being invalidate because project 6b8a1882567f4359be2e7d490a1521d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:21.962646 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.963331 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5c1a51f4-e8a2-4b23-8e4f-691522402347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:21.964965 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1403/2801] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:21 2022] DELETE /identity/v3/projects/6b8a1882567f4359be2e7d490a1521d8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:21.969849 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:21.970344 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:21.970464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:21.988416 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:21.989636 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:22.049249 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1399/2802] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:22.058067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.058397 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.058713 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.078168 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:22.079409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:22.087463 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1404/2803] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:22.091665 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.101477 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03965e4e-05a5-4caa-beaf-def8cec47c7e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.106720 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.107388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.107676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.107979 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.108818 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:39:22.109137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.110787 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.123233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1400/2804] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:39:22.127460 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.137141 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be58b0-9f2e-46ce-a685-7912b3748de5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.141889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.142574 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.142865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.143177 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.143884 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.149360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.252803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1405/2805] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:22.257050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.264128 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:22.268090 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3ec38-76e4-4d1c-bd1c-6bee4e2df7ba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.326448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.327122 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.327435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.327718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.328422 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.330405 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.407273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1401/2806] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:22.411462 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.422009 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194488-1906-4383-992e-f515d8546701 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.426866 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.427539 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.427888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.428097 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.428820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.430962 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.441867 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1406/2807] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:22.446718 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.456672 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141429ae-35c3-4ddf-ad6d-ea4b20805632 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.461397 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.462054 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.462438 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.462722 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.463455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.465059 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b983-bc6a-49b8-8035-50a119ecb5eb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.475092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1402/2808] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:22.479388 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.489495 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c97bc-e7ac-4573-bfe8-0f6655267e5b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.494575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.495450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.495736 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.496016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] PATH_INFO: `/v3/projects/77a091f6e8d648e985eca6bcb652eaa8/users/9877c89b241e448db72820a8ac6cb265/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.511575 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a091f6e8d648e985eca6bcb652eaa8, user_id=9877c89b241e448db72820a8ac6cb265, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.514257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.584238 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1407/2809] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:22 2022] PUT /identity/v3/projects/77a091f6e8d648e985eca6bcb652eaa8/users/9877c89b241e448db72820a8ac6cb265/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:22.595351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.595652 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.595939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.622929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] MFA Rules not processed for user `9877c89b241e448db72820a8ac6cb265`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:22.624171 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:22.690609 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1403/2810] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:22.695314 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.767020 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715b23-3908-42b5-bbb4-db99119b427b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.771812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.772504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.772790 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.773070 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.773894 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.776035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:22.906628 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1408/2811] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:22.910737 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:22.922429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb97b-8cf2-4477-8003-dad309eb4281 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:22.978937 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:22.979664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:22.979949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:22.980233 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:22.980929 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:22.982903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.064960 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1404/2812] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:22 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:23.069079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.074832 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:23.080151 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4e3d-976e-48f7-b7cc-f5aede38b0fe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.085079 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.085735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.086027 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.086828 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.087559 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.089174 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.099803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1409/2813] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:39:23.108144 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.113557 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:23.119447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f78ce4-f2ac-412d-90af-186d7e0007a6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.124227 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.124897 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.125182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.125459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.126187 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.128102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383cbfa-6c4b-4c3c-90e6-8e90636b82d6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.138858 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1405/2814] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:23.143589 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.153959 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccaa47-f37e-4c24-be05-f401e05b6478 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.158963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.160394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.160394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.160605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] PATH_INFO: `/v3/projects/cbb55f18d6c04d6f92514e74bdf81fc9/users/4f402376f86a4859afab07c5f142aa6f/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.176517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb55f18d6c04d6f92514e74bdf81fc9, user_id=4f402376f86a4859afab07c5f142aa6f, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.179257 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.276785 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1410/2815] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:23 2022] PUT /identity/v3/projects/cbb55f18d6c04d6f92514e74bdf81fc9/users/4f402376f86a4859afab07c5f142aa6f/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:23.287276 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.287598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.287906 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.314721 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] MFA Rules not processed for user `4f402376f86a4859afab07c5f142aa6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:23.315997 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:23.383109 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1406/2816] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:23.387672 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.450205 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad174a-f9ef-48d7-b53e-109d1c6ad679 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.455011 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.455665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.455956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.456240 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.456951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.458876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.539947 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1411/2817] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:23 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:23.544001 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.555022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af112-7aae-411b-a2ca-28ff9aa40f5b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.611603 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.612177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.612483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.612754 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.613454 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.615428 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.699588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1407/2818] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:23 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:23.703371 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.714412 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de5b28-e159-4a97-9ee9-1680bbef4180 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.719164 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.719836 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.720169 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.720458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.721190 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.722817 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.733541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1412/2819] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:23.737633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.747821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de452cf-0299-439a-8886-b5cf6a504de4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.752866 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.753990 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.754317 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.754599 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] PATH_INFO: `/v3/projects/d3f7580ecf6a437195d771160a69d261/users/d668db89e10f4c5eb20a563b49e7d36c/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.769740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f7580ecf6a437195d771160a69d261, user_id=d668db89e10f4c5eb20a563b49e7d36c, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.772485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.830498 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1408/2820] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:23 2022] PUT /identity/v3/projects/d3f7580ecf6a437195d771160a69d261/users/d668db89e10f4c5eb20a563b49e7d36c/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:23.834533 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.844639 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ad90-29b8-4c2b-a233-7f6fc4e034d9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.902554 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.903128 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.903415 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.903699 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.904436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.906049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d378ba8-1130-4f63-a2ee-acb6fd57e2e2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.916446 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1413/2821] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:23.920808 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:23.932273 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf13164-7cb8-4726-9812-af7b88ab8b60 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:23.937216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:23.938120 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.938439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.938719 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] PATH_INFO: `/v3/projects/d3f7580ecf6a437195d771160a69d261/users/d668db89e10f4c5eb20a563b49e7d36c/roles/a37517ecfb38458e8399e44c1ab88230` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.940714 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f7580ecf6a437195d771160a69d261, user_id=d668db89e10f4c5eb20a563b49e7d36c, role_id=a37517ecfb38458e8399e44c1ab88230)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:23.943417 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:23.954713 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1409/2822] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:23 2022] PUT /identity/v3/projects/d3f7580ecf6a437195d771160a69d261/users/d668db89e10f4c5eb20a563b49e7d36c/roles/a37517ecfb38458e8399e44c1ab88230 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:23.965382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:23.965677 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:23.965963 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:23.994084 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] MFA Rules not processed for user `d668db89e10f4c5eb20a563b49e7d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:23.995364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:24.023706 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:24.070317 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1414/2823] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:24.083136 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:24.084904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:24.120957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:24.144043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a605e4-7c1b-4e8c-9199-1d5119d97cd7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:24.147807 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:24.148458 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:24.148752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:24.149036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:24.206163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:24.207668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:24.217143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1410/2824] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:26.206465 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:26.207924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:26.221644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271269-806a-4374-a3fe-4e35e092c92e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:26.225476 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:26.226134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:26.226459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:26.227347 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:26.284620 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:26.286077 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:26.295638 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1415/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:27.836450 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:27.845084 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb960f-4476-4188-a9c2-54cc458b7144 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:27.848812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:27.849449 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:27.849741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:27.850044 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:27.859246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:27.860772 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778052d-3607-482e-8c0c-b3436a43395e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:27.871124 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1411/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:32.539551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:32.605882 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5c3c-1a93-4ec1-8f76-6940b610caa6 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:32.610393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:32.611268 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:32.611606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:32.611823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] PATH_INFO: `/v3/users/9877c89b241e448db72820a8ac6cb265` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:32.612997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9877c89b241e448db72820a8ac6cb265)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:32.614944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:32.866482 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9877c89b241e448db72820a8ac6cb265'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:32.867565 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9877c89b241e448db72820a8ac6cb265'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:32.868176 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9877c89b241e448db72820a8ac6cb265'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:32.879607 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:32.881019 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9877c89b241e448db72820a8ac6cb265'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:32.970536 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9877c89b241e448db72820a8ac6cb265'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:32.983546 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1416/2827] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:32 2022] DELETE /identity/v3/users/9877c89b241e448db72820a8ac6cb265 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:32.988043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:32.988537 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:32.988655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:33.006486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:33.008292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:33.067668 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1412/2828] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:33.078579 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:33.079508 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:33.139159 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4f6-471f-4375-a939-07a3734743a7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:33.142856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:33.143517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:33.143803 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:33.144085 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:33.154478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:33.155915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:33.169954 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1417/2829] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:33.625892 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:33.627738 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:33.642533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925bf3f-ff02-463b-a063-5bc582247d2e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:33.649300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:33.650240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:33.651413 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:33.651705 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] PATH_INFO: `/v3/projects/77a091f6e8d648e985eca6bcb652eaa8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:33.653290 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a091f6e8d648e985eca6bcb652eaa8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:33.655269 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:33.767752 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a091f6e8d648e985eca6bcb652eaa8', 'request_id': 'req-3ef81e61-0bed-4543-853d-18948a4ef660'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:33.844561 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a091f6e8d648e985eca6bcb652eaa8', 'request_id': 'req-3ef81e61-0bed-4543-853d-18948a4ef660'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:33.851340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a091f6e8d648e985eca6bcb652eaa8', 'request_id': 'req-3ef81e61-0bed-4543-853d-18948a4ef660'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:33.858466 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:33.863132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] The token cache is being invalidate because project 77a091f6e8d648e985eca6bcb652eaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:33.863455 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:33.864133 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:33.865684 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1413/2830] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:33 2022] DELETE /identity/v3/projects/77a091f6e8d648e985eca6bcb652eaa8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:33.869856 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:33.880216 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39777-0cc6-40e0-af53-a525ebd43a74 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:33.938743 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:33.939527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:33.939810 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:33.940222 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] PATH_INFO: `/v3/users/4f402376f86a4859afab07c5f142aa6f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:33.941426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f402376f86a4859afab07c5f142aa6f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:33.943421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:34.155531 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f402376f86a4859afab07c5f142aa6f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.157542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f402376f86a4859afab07c5f142aa6f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.157542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f402376f86a4859afab07c5f142aa6f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.169402 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f402376f86a4859afab07c5f142aa6f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.241212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f402376f86a4859afab07c5f142aa6f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.254940 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1418/2831] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:33 2022] DELETE /identity/v3/users/4f402376f86a4859afab07c5f142aa6f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:34.625544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:34.640094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:34.641020 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef81e61-0bed-4543-853d-18948a4ef660 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:34.700675 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:34.701542 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:34.701827 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:34.702112 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] PATH_INFO: `/v3/projects/cbb55f18d6c04d6f92514e74bdf81fc9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:34.703341 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb55f18d6c04d6f92514e74bdf81fc9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:34.705271 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:34.800658 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb55f18d6c04d6f92514e74bdf81fc9', 'request_id': 'req-531ce875-833e-44bd-af83-fff4c95fbc76'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.858624 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb55f18d6c04d6f92514e74bdf81fc9', 'request_id': 'req-531ce875-833e-44bd-af83-fff4c95fbc76'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.866429 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb55f18d6c04d6f92514e74bdf81fc9', 'request_id': 'req-531ce875-833e-44bd-af83-fff4c95fbc76'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.877247 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] The token cache is being invalidate because project cbb55f18d6c04d6f92514e74bdf81fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:34.877544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.878272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:34.880177 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1414/2832] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:34 2022] DELETE /identity/v3/projects/cbb55f18d6c04d6f92514e74bdf81fc9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:34.885015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:34.887997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:34.894420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:34.900606 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872c934-c9a1-4894-91bb-d0508c45e649 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:34.957801 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:34.958710 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:34.958997 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:34.959275 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] PATH_INFO: `/v3/users/d668db89e10f4c5eb20a563b49e7d36c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:34.960534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d668db89e10f4c5eb20a563b49e7d36c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:34.963113 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:35.149872 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd668db89e10f4c5eb20a563b49e7d36c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.150527 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd668db89e10f4c5eb20a563b49e7d36c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.151152 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd668db89e10f4c5eb20a563b49e7d36c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.163627 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd668db89e10f4c5eb20a563b49e7d36c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.241227 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b2e49fd-7d20-4325-afe8-c73472c267ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd668db89e10f4c5eb20a563b49e7d36c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.255635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1419/2833] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:39:34 2022] DELETE /identity/v3/users/d668db89e10f4c5eb20a563b49e7d36c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:35.677521 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:35.679052 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:35.692829 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce875-833e-44bd-af83-fff4c95fbc76 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:35.751837 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:35.752696 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:35.752904 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:35.753185 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] PATH_INFO: `/v3/projects/d3f7580ecf6a437195d771160a69d261` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:35.754891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f7580ecf6a437195d771160a69d261)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:35.756847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:35.849499 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:35.863447 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f7580ecf6a437195d771160a69d261', 'request_id': 'req-9d7fab63-7138-4c4b-a717-a683328456e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.926511 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f7580ecf6a437195d771160a69d261', 'request_id': 'req-9d7fab63-7138-4c4b-a717-a683328456e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.933125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f7580ecf6a437195d771160a69d261', 'request_id': 'req-9d7fab63-7138-4c4b-a717-a683328456e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.943901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] The token cache is being invalidate because project d3f7580ecf6a437195d771160a69d261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:39:35.943901 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.944478 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d7fab63-7138-4c4b-a717-a683328456e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:39:35.946299 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1415/2834] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:39:35 2022] DELETE /identity/v3/projects/d3f7580ecf6a437195d771160a69d261 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:35.951156 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:35.951650 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:35.951820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:35.971282 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:35.972504 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:36.033977 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1420/2835] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:36.041868 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.042740 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.043022 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.061105 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:36.062355 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:36.070367 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1416/2836] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:36.074659 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.084581 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f97f8-7345-418d-b48d-e3087bf1031c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.089680 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.090377 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.090668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.090948 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.091676 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:39:36.091986 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.093588 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.105877 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1421/2837] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:39:36.110435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.119822 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7144a2-c0a0-4493-a210-6ce2410a58fa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.124562 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.125254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.125548 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.125833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.126588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.128485 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.221232 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1417/2838] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:39:36 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:36.225297 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.235740 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d3539-2ad3-4cbb-b29b-89b1e5fe773e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.240308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:36.292420 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.293095 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.293382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.293664 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.294410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.296373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.388888 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1422/2839] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:39:36 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:39:36.393102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.404448 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02075a3-4a06-434e-a98e-50c58828957e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.409206 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.409877 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.410167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.410479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.411237 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.412854 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.424717 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1418/2840] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:36.428708 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.439111 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3328f0-68a2-4f64-8bbc-2575a6a4fd95 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.443820 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.444478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.444798 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.445568 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.446327 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.447929 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7920af-5cb3-4e85-986c-5d28204ce974 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.458093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1423/2841] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:39:36.462811 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.472900 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ed1-19c2-4f25-acc8-a58dce401597 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.477533 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.478389 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.478676 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.478952 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] PATH_INFO: `/v3/projects/d34117845b69401085cd262082799c57/users/f091c84f8a514fc8b397a8cbc700b82d/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.493354 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34117845b69401085cd262082799c57, user_id=f091c84f8a514fc8b397a8cbc700b82d, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.496050 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.576685 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1419/2842] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:39:36 2022] PUT /identity/v3/projects/d34117845b69401085cd262082799c57/users/f091c84f8a514fc8b397a8cbc700b82d/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:39:36.581869 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff93a9-b884-4287-a9fa-4ea2f85579aa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.582212 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff93a9-b884-4287-a9fa-4ea2f85579aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.582510 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff93a9-b884-4287-a9fa-4ea2f85579aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.600267 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ebff93a9-b884-4287-a9fa-4ea2f85579aa None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:36.601654 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ebff93a9-b884-4287-a9fa-4ea2f85579aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:36.662149 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1424/2843] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:36.672244 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:36.674009 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:36.732040 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f818bd-0a2e-4d3f-ba9f-225723ae8096 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:36.736091 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:36.736782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:36.737071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:36.737351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:36.747217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:36.748655 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:36.759588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1420/2844] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:37.927857 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785e48-de3d-494a-bd7a-daca50230e61 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:37.930188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785e48-de3d-494a-bd7a-daca50230e61 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:37.930188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785e48-de3d-494a-bd7a-daca50230e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:37.957808 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce785e48-de3d-494a-bd7a-daca50230e61 None None] MFA Rules not processed for user `f091c84f8a514fc8b397a8cbc700b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:37.959116 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce785e48-de3d-494a-bd7a-daca50230e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:38.027917 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1425/2845] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:38.040132 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:38.041663 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:38.099073 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838bac9-d5a9-40ab-b8d6-615e718d7578 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:38.103363 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:38.104007 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:38.104301 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:38.104586 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:38.113492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:38.114986 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:38.119608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:38.124298 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1421/2846] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:39.798995 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14aa69-21d8-429c-a99a-ac91660c9571 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:39.799564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14aa69-21d8-429c-a99a-ac91660c9571 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:39.799564 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14aa69-21d8-429c-a99a-ac91660c9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:39.816744 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe14aa69-21d8-429c-a99a-ac91660c9571 None None] MFA Rules not processed for user `f091c84f8a514fc8b397a8cbc700b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:39:39.817956 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe14aa69-21d8-429c-a99a-ac91660c9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:39.824807 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1426/2847] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:39:40.305025 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:39:40.314442 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a4ec-e908-4827-8d90-d1b371ca12c4 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:39:40.318293 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:39:40.318946 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:39:40.319235 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:39:40.319518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:39:40.321327 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:39:40.331338 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:39:40.332894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:39:40.341670 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1422/2848] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:39:49.811645 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:39:50.337972 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:02.546052 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325f9e-8315-4389-a18a-27f6131d9196 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:02.551932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325f9e-8315-4389-a18a-27f6131d9196 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:02.551932 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11325f9e-8315-4389-a18a-27f6131d9196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:02.564722 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-11325f9e-8315-4389-a18a-27f6131d9196 None None] MFA Rules not processed for user `f091c84f8a514fc8b397a8cbc700b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:02.565935 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-11325f9e-8315-4389-a18a-27f6131d9196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:02.573450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1427/2849] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:40:02.811951 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:02.813376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:02.824239 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5155c1-81c9-44d2-b188-eaa4c9c5ff69 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:02.828166 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:02.828812 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:02.829097 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:02.829371 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:02.831155 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:02.841469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:02.842928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:02.851031 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1423/2850] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:40:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:40:12.559535 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:12.847382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:22.636090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc597f-1c5e-44a3-9eca-4628a8b25bd5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:22.639050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc597f-1c5e-44a3-9eca-4628a8b25bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:22.639050 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc597f-1c5e-44a3-9eca-4628a8b25bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:22.654901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f3fc597f-1c5e-44a3-9eca-4628a8b25bd5 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:22.656135 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f3fc597f-1c5e-44a3-9eca-4628a8b25bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:22.713742 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1428/2851] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Jul 4 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:40:22.850080 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:22.851551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:22.921092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5897a-179f-45cc-8500-adfe1757a387 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:22.926140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:22.926821 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:22.927111 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:22.927394 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:22.936490 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:22.938125 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:22.946272 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1424/2852] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:40:32.706593 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:32.943143 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=32 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:40.394831 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:40.395303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:40.395414 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:40.414046 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] MFA Rules not processed for user `18c8feb5103b47c2a185f2aa32bb37f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:40.415279 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:40.422701 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1429/2853] 10.222.0.61 () {58 vars in 967 bytes} [Mon Jul 4 09:40:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:40:40.435264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:40.445953 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32fb0-0800-46dd-b80e-b8f1beb99445 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:40.451935 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9bf3dd7ae04319987bd7a26c94ed20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:40.452580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:40.452863 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:40.453137 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:40.461583 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:40.463192 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:40.471209 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1425/2854] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Jul 4 09:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:40:43.416247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:43.428667 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa9d5-b7aa-4834-a739-34281070dcf0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:43.434247 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:43.435256 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:43.435484 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:43.435780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] PATH_INFO: `/v3/users/f091c84f8a514fc8b397a8cbc700b82d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:43.436876 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f091c84f8a514fc8b397a8cbc700b82d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:43.439000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:43.585426 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f091c84f8a514fc8b397a8cbc700b82d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:43.586026 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f091c84f8a514fc8b397a8cbc700b82d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:43.586678 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f091c84f8a514fc8b397a8cbc700b82d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:43.598623 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f091c84f8a514fc8b397a8cbc700b82d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:43.657328 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e2e23e00-26fa-4d53-a210-f7d5cfb07e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f091c84f8a514fc8b397a8cbc700b82d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:43.670858 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1430/2855] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:40:43 2022] DELETE /identity/v3/users/f091c84f8a514fc8b397a8cbc700b82d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:40:43.887315 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:43.897898 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1c69-72ca-435f-a008-98199c3618ef service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:43.955961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:43.956830 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:43.957117 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:43.957401 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] PATH_INFO: `/v3/projects/d34117845b69401085cd262082799c57` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:43.958639 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34117845b69401085cd262082799c57)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:43.960558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.073339 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34117845b69401085cd262082799c57', 'request_id': 'req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:44.149410 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34117845b69401085cd262082799c57', 'request_id': 'req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:44.159071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34117845b69401085cd262082799c57', 'request_id': 'req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:44.171268 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] The token cache is being invalidate because project d34117845b69401085cd262082799c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:40:44.171633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:44.172254 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5a30f49f-3636-4c5c-8847-ea8a91c1f8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:40:44.173859 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1426/2856] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:40:43 2022] DELETE /identity/v3/projects/d34117845b69401085cd262082799c57 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:40:44.178806 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.179127 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.179444 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.197893 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:44.199188 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:44.261379 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1431/2857] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:40:44.269673 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.269958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.270277 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.288661 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:44.289847 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:44.298551 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1427/2858] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:40:44.302762 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.312617 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6e7b2-9b64-41de-a3a1-1b053452c052 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.317090 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.317741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.318035 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.318362 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.319093 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:40:44.319407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.321016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.333186 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1432/2859] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:40:44.337614 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.347757 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230b36-27df-4467-a176-41fdef23fd94 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.352385 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.353036 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.353331 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.353613 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.356356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.356356 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.419534 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1428/2860] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:40:44 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:40:44.423827 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.434343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4895bf-3578-4e11-be98-a39c4ebd1054 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.483120 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:44.492016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.492720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.493012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.493299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.494028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.496062 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.586467 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1433/2861] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:40:44 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:40:44.591191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.601723 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aca59-d005-4f0f-bebd-c2735966d8a6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.606432 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.607094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.607380 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.607657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.608423 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.610051 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.620642 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1429/2862] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:40:44.624745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.635734 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4d22-8f58-4d7a-8209-78e8377316a0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.640906 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.641578 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.641865 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.642146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.642915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.644549 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe235-1643-4c18-97c2-78435854422e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.655500 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1434/2863] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:40:44.659664 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.669699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a48162-b3d4-4c48-b760-80c8382d9348 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.674382 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.675263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.675556 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.675840 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] PATH_INFO: `/v3/projects/7004e37e16cf435cb4218b238dc0e4c6/users/db527627cda7410997505dc3c6756a48/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.690707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7004e37e16cf435cb4218b238dc0e4c6, user_id=db527627cda7410997505dc3c6756a48, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.693386 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:44.801145 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1430/2864] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:40:44 2022] PUT /identity/v3/projects/7004e37e16cf435cb4218b238dc0e4c6/users/db527627cda7410997505dc3c6756a48/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:40:44.811933 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.812229 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.812542 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.839694 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] MFA Rules not processed for user `db527627cda7410997505dc3c6756a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:40:44.840975 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:44.905252 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1435/2865] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:40:44.916647 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:40:44.918471 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:40:44.933275 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:44.976328 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb661-3faf-4008-8355-3660b889121b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:40:44.980094 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:40:44.980733 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:40:44.981017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:40:44.981292 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:40:44.990212 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:40:44.991650 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8894bf7-39d6-411d-854c-01f4322a17f5 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:40:45.000961 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1431/2866] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:40:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:40:54.902299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:40:55.049240 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=20 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:18.458458 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:18.527698 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0324213-5d14-4895-8df2-16c5a4fe93db None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:18.532592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:18.533483 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:18.533768 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:18.534089 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] PATH_INFO: `/v3/users/db527627cda7410997505dc3c6756a48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:18.535573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db527627cda7410997505dc3c6756a48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:18.537647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:18.739765 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db527627cda7410997505dc3c6756a48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:18.740455 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db527627cda7410997505dc3c6756a48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:18.741067 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db527627cda7410997505dc3c6756a48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:18.753352 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db527627cda7410997505dc3c6756a48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:18.825813 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db527627cda7410997505dc3c6756a48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:18.838356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1436/2867] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:41:18 2022] DELETE /identity/v3/users/db527627cda7410997505dc3c6756a48 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:41:18.842903 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:18.843414 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:18.843620 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:18.861388 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:18.863267 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:18.920911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1432/2868] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:18.931351 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:18.932774 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:18.989879 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4270d0-262d-4981-9da1-47e947a7fb2d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:18.993612 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:18.994303 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:18.994592 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:18.994870 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.004013 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:19.005690 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8587c57-ebff-44a1-9ff9-4c56ba20750e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:19.015132 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1437/2869] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:19.438881 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:19.440894 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:19.453280 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47989d-f208-4ffa-bb1c-321b166a4337 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:19.458649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:19.459552 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.459861 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.460140 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] PATH_INFO: `/v3/projects/7004e37e16cf435cb4218b238dc0e4c6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.461368 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7004e37e16cf435cb4218b238dc0e4c6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:19.463366 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:19.581424 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7004e37e16cf435cb4218b238dc0e4c6', 'request_id': 'req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:19.651362 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7004e37e16cf435cb4218b238dc0e4c6', 'request_id': 'req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:19.658043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7004e37e16cf435cb4218b238dc0e4c6', 'request_id': 'req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:19.668351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] The token cache is being invalidate because project 7004e37e16cf435cb4218b238dc0e4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:41:19.670230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:19.670230 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7bf6266a-38ba-4019-8979-9e9ba2dd35c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:41:19.670950 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1433/2870] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:41:19 2022] DELETE /identity/v3/projects/7004e37e16cf435cb4218b238dc0e4c6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:41:19.675784 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.676259 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.676360 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.694072 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:19.695312 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:19.713148 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:19.755573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1438/2871] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:19.763203 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b549fe-253e-45a4-8940-107a92272717 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.763507 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b549fe-253e-45a4-8940-107a92272717 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.763788 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b549fe-253e-45a4-8940-107a92272717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.781833 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-22b549fe-253e-45a4-8940-107a92272717 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:19.783067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-22b549fe-253e-45a4-8940-107a92272717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:19.791004 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1434/2872] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:19.795158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:19.805343 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ca00-982d-4436-8e3d-b3f4ea1660d5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:19.809915 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:19.812032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.812032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.812032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.812032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:41:19.812409 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:19.813741 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:19.825658 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1439/2873] 10.222.0.61 () {58 vars in 1152 bytes} [Mon Jul 4 09:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:41:19.829938 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b549fe-253e-45a4-8940-107a92272717 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:19.839158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b549fe-253e-45a4-8940-107a92272717 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:19.843707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:19.844351 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.844637 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.844914 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.845598 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:19.847539 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:19.924928 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1435/2874] 10.222.0.61 () {60 vars in 1152 bytes} [Mon Jul 4 09:41:19 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:41:19.928561 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:19.938389 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97391f21-1b9f-4697-af69-8f8306bf8a5a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:19.994848 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:19.995517 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:19.995850 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:19.996134 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:19.996838 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:19.998786 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:20.072512 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1440/2875] 10.222.0.61 () {60 vars in 1143 bytes} [Mon Jul 4 09:41:19 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:41:20.076657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:20.087843 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a857-17d4-4cbb-b6af-9593c3a1ca43 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:20.092526 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:20.093191 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:20.093479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:20.093791 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:20.094558 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:20.096167 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:20.107404 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1436/2876] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:41:20.111408 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:20.121537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9bbf3-53b4-4699-8801-76edfa034718 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:20.126523 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:20.127192 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:20.127969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:20.128283 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:20.129015 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:20.130924 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bef0c9-32c4-45e9-af0d-994a4b91d967 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:20.141040 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1441/2877] 10.222.0.61 () {58 vars in 1121 bytes} [Mon Jul 4 09:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:41:20.145794 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:20.155759 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110aa0c-920e-430c-9110-55073b459bb4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:20.160346 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:20.161216 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:20.161501 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:20.161782 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] PATH_INFO: `/v3/projects/aa5c50370f434081ba04274bd912c36c/users/8bfb1142369b4c8dabcf66d858f4c6b3/roles/6c20fa00522f4c2ebc9271f5a702779e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:20.176260 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5c50370f434081ba04274bd912c36c, user_id=8bfb1142369b4c8dabcf66d858f4c6b3, role_id=6c20fa00522f4c2ebc9271f5a702779e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:20.178893 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:20.237741 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1437/2878] 10.222.0.61 () {60 vars in 1482 bytes} [Mon Jul 4 09:41:20 2022] PUT /identity/v3/projects/aa5c50370f434081ba04274bd912c36c/users/8bfb1142369b4c8dabcf66d858f4c6b3/roles/6c20fa00522f4c2ebc9271f5a702779e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:41:20.244010 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbd35-46ab-491c-b070-c73bc659a5df None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:20.244308 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbd35-46ab-491c-b070-c73bc659a5df None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:20.244595 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbd35-46ab-491c-b070-c73bc659a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:20.263443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-818bbd35-46ab-491c-b070-c73bc659a5df None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:20.264663 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-818bbd35-46ab-491c-b070-c73bc659a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:20.324158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1442/2879] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:20.334439 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:20.336138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:20.357274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:20.392320 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e68c-30c2-4a2b-b7ba-23fd2c1cd29a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:20.396538 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:20.397182 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:20.397467 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:20.397747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:20.406700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:20.408141 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:20.417649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1438/2880] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:21.707478 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342de46-e64d-4244-95dc-7c8cfc7bdb5c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:21.708016 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342de46-e64d-4244-95dc-7c8cfc7bdb5c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:21.708133 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342de46-e64d-4244-95dc-7c8cfc7bdb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:21.735296 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e342de46-e64d-4244-95dc-7c8cfc7bdb5c None None] MFA Rules not processed for user `8bfb1142369b4c8dabcf66d858f4c6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:21.736529 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e342de46-e64d-4244-95dc-7c8cfc7bdb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:21.754171 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:21.806287 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1443/2881] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:21.817570 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:21.819129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:21.875577 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8c9b-68fd-410f-981c-146b5f2882e1 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:21.880129 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a987fcd616f48c09f4279f8dfb79740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:21.880775 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:21.881064 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:21.881348 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:21.889762 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:21.891383 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:21.900920 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1439/2882] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:23.690472 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:23.691022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:23.691022 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:23.708918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] MFA Rules not processed for user `8bfb1142369b4c8dabcf66d858f4c6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:23.710129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:23.717198 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1444/2883] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:41:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:23.754400 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:23.756083 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:23.812310 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50554-1cb1-4b49-8d97-5d92b6c128c1 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:23.816591 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a39dae9c774d8a8f4755e9a0c2596d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:23.817231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:23.817515 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:23.817792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:23.819564 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:23.888958 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:23.890395 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068732-4d6c-4152-be3b-32c5cbb8bc44 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:23.902021 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1440/2884] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:24.556024 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:24.557459 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:24.570622 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec88e-e424-4a25-a008-331f1e6591f7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:24.574413 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:24.575059 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:24.575374 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:24.575661 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:24.577644 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:24.593073 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:24.594541 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:24.606635 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1445/2885] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:33.897092 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:34.601473 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=28 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:41:53.611792 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10fe33-cf60-4caa-bc35-b1a279490949 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:53.612379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10fe33-cf60-4caa-bc35-b1a279490949 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:53.612379 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10fe33-cf60-4caa-bc35-b1a279490949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:53.630919 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8d10fe33-cf60-4caa-bc35-b1a279490949 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:53.632158 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8d10fe33-cf60-4caa-bc35-b1a279490949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:53.640744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1441/2886] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:53.656410 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:53.657843 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:53.671552 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42e518-1281-473c-9362-6422ece8f435 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:53.677000 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:53.677633 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:53.677918 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:53.678234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:53.687109 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:53.688693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:53.699194 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1446/2887] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:41:57.881536 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8426-e7a4-43f9-8973-02e7ee048e7c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:57.882067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8426-e7a4-43f9-8973-02e7ee048e7c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:57.882067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8426-e7a4-43f9-8973-02e7ee048e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:57.900942 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8c9e8426-e7a4-43f9-8973-02e7ee048e7c None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:41:57.902779 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8c9e8426-e7a4-43f9-8973-02e7ee048e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:57.911046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1442/2888] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:41:57.924878 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:41:57.926442 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:41:57.941759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f89b5-32a9-4861-ad50-3fd56ea2d652 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:41:57.947376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:41:57.948534 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:41:57.948823 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:41:57.949104 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:41:57.957441 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:41:57.959123 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:41:57.969493 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1447/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:01.399199 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d743f-57fe-41d3-9e5a-7aeba5e30f0f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:01.399771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d743f-57fe-41d3-9e5a-7aeba5e30f0f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:01.399771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d743f-57fe-41d3-9e5a-7aeba5e30f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:01.418138 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3d0d743f-57fe-41d3-9e5a-7aeba5e30f0f None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:01.419495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3d0d743f-57fe-41d3-9e5a-7aeba5e30f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:01.427984 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1443/2890] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:01.442012 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:01.454302 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adab81-eacd-4fe8-9f52-1d256cb00385 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:01.459910 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:01.460551 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:01.460839 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:01.461122 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:01.469393 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:01.471505 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:01.481345 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1448/2891] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:04.244430 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5a41-0392-4d45-bd4c-0f50d916c894 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:04.244941 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5a41-0392-4d45-bd4c-0f50d916c894 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:04.245049 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5a41-0392-4d45-bd4c-0f50d916c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:04.264633 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d08a5a41-0392-4d45-bd4c-0f50d916c894 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:04.265825 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d08a5a41-0392-4d45-bd4c-0f50d916c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:04.273688 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1444/2892] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:04.288714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:04.300153 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135e6a-7cd6-4e47-92c0-ef3c33f373e8 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:04.305707 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:04.306394 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:04.306684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:04.306969 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:04.315729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:04.317318 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:04.327438 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1449/2893] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:07.466483 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f95c-0848-4492-9d2e-a4eca7d0017b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:07.467017 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f95c-0848-4492-9d2e-a4eca7d0017b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:07.467657 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f95c-0848-4492-9d2e-a4eca7d0017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:07.485340 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d258f95c-0848-4492-9d2e-a4eca7d0017b None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:07.486505 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d258f95c-0848-4492-9d2e-a4eca7d0017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:07.494381 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1445/2894] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:07.512666 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:07.524470 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8cbb-20cb-495c-b824-1b7d66218cb0 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:07.530821 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:07.531466 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:07.531754 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:07.532044 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:07.540439 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:07.541990 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:07.551501 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1450/2895] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:10.808039 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:10.808518 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:10.808616 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:10.827913 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:10.829156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:10.836939 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1446/2896] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:10.852292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:10.868992 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36a43-3432-477d-af9c-ea7ef93d534a service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:10.874714 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:10.875369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:10.875668 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:10.875942 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:10.885537 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:10.887248 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:10.897049 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1451/2897] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:13.772528 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:13.783297 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3f78-045e-4889-916f-068d6ca260a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:13.786957 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ed1189200a44605a751549c6045f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:13.787608 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:13.787899 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:13.788183 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:13.789973 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:13.800016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:13.801459 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b34f1-3c75-4243-b4b7-e67716e65031 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:13.809580 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1447/2898] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:20.893201 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=36 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:42:20.934028 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:20.945299 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a4020-f3fb-4517-871c-3109e9d7f569 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:20.950748 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:20.951382 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:20.951665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:20.951944 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:20.953720 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:20.966914 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:20.968503 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:20.979733 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1452/2899] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:23.805870 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=24 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:42:26.867638 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:26.868263 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:26.868359 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:26.887016 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] MFA Rules not processed for user `8bfb1142369b4c8dabcf66d858f4c6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:26.888217 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:26.895231 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1448/2900] 10.222.0.61 () {58 vars in 957 bytes} [Mon Jul 4 09:42:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:42:27.582436 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:27.588373 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:27.656582 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40884e57-3b3b-413c-ae06-efa2f430f8c4 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:27.662376 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:27.663032 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:27.663322 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:27.663605 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:27.665443 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:27.677129 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:27.678759 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e583-8a4a-4140-8ca2-20a36ffdd660 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:27.688735 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1453/2901] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:36.881568 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:42:37.684407 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=38 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:42:37.825588 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:37.838486 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06f88-f9b0-4c1d-8bf4-b0297499cc6b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:37.843968 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:37.844649 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:37.844936 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:37.845218 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:37.847030 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:37.860071 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:37.861764 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:37.873700 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1449/2902] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:43.926346 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79526-5623-41c7-a865-7ee4da6ffb54 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:43.926931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79526-5623-41c7-a865-7ee4da6ffb54 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:43.926931 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79526-5623-41c7-a865-7ee4da6ffb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:43.947421 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6da79526-5623-41c7-a865-7ee4da6ffb54 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:43.948684 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6da79526-5623-41c7-a865-7ee4da6ffb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:43.956660 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1454/2903] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:43.970500 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:43.981907 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7910a6-764a-4b50-8998-c273797da4d4 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:43.996699 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:43.997479 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:43.997836 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:43.998131 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:44.007623 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:44.010060 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:44.020891 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1450/2904] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:47.375812 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc46d-b0d1-4f9c-95f6-b08ced5cceba None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:47.376369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc46d-b0d1-4f9c-95f6-b08ced5cceba None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:47.376369 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc46d-b0d1-4f9c-95f6-b08ced5cceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:47.394468 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99adc46d-b0d1-4f9c-95f6-b08ced5cceba None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:47.399454 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99adc46d-b0d1-4f9c-95f6-b08ced5cceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:47.403737 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1455/2905] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:47.418043 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:47.429314 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8c94-cb31-4a26-97ff-05af46cc6e94 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:47.435544 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:47.436300 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:47.436461 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:47.436744 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:47.445055 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:47.446682 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:47.456274 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1451/2906] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:50.222729 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd46b-29c8-4f00-8eef-7785aac937f0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:50.223150 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd46b-29c8-4f00-8eef-7785aac937f0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:50.223292 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd46b-29c8-4f00-8eef-7785aac937f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:50.241637 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ee0dd46b-29c8-4f00-8eef-7785aac937f0 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:50.243665 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ee0dd46b-29c8-4f00-8eef-7785aac937f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:50.251580 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1456/2907] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 09:42:50.283975 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:50.295823 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468688-e964-4cbd-891d-8aa7d0eecf5c service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:50.301415 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:50.306028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:50.306028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:50.306028 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:50.311869 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:50.313465 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:50.323376 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1452/2908] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:53.526655 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e4e6-9f37-4715-b3b1-bf7d05f62e6e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:53.527158 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e4e6-9f37-4715-b3b1-bf7d05f62e6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:53.527278 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3e4e6-9f37-4715-b3b1-bf7d05f62e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:53.545901 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eca3e4e6-9f37-4715-b3b1-bf7d05f62e6e None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:53.547146 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eca3e4e6-9f37-4715-b3b1-bf7d05f62e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:53.555006 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1457/2909] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:53.572077 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:53.583646 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191d9f-e6e0-47de-8b2a-abffcd3d65ae service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:53.589161 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:53.589944 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:53.590264 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:53.590554 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:53.607949 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:53.614130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:53.621911 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1453/2910] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:42:56.783219 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:56.783693 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:56.783778 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:56.801756 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] MFA Rules not processed for user `4e3cc86167294f7c9616a6b3d1573df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:42:56.802987 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:42:56.811629 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1458/2911] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jul 4 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 09:42:56.826841 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:42:56.838963 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62cb6-ba39-4f08-a5cd-3a7a7c6b3353 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:42:56.844446 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0991f43889c4092baff1a5a1099d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:42:56.845130 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:42:56.845469 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:42:56.845693 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:42:56.854473 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:42:56.856075 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:42:56.865817 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1454/2912] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:43:06.796399 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=15 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:43:06.861495 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=36 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:43:27.510110 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:43:27.554165 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b6e8-5c66-4aee-bb43-68676a71c626 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:43:27.559356 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:43:27.560045 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:43:27.560339 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:43:27.560615 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:43:27.562450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:43:27.593573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:43:27.595225 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:43:27.605745 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1459/2913] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:43:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:43:27.647102 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:43:27.700464 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5e2d-3cd4-4e06-b9e6-d44a338bd4e2 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:43:27.705015 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:43:27.706488 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:43:27.706771 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:43:27.707046 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] PATH_INFO: `/v3/users/8bfb1142369b4c8dabcf66d858f4c6b3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:43:27.708246 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfb1142369b4c8dabcf66d858f4c6b3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:43:27.710163 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:43:27.931492 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfb1142369b4c8dabcf66d858f4c6b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:27.932067 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfb1142369b4c8dabcf66d858f4c6b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:27.997196 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfb1142369b4c8dabcf66d858f4c6b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.005463 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfb1142369b4c8dabcf66d858f4c6b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.006437 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfb1142369b4c8dabcf66d858f4c6b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.023444 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1455/2914] 10.222.0.61 () {58 vars in 1223 bytes} [Mon Jul 4 09:43:27 2022] DELETE /identity/v3/users/8bfb1142369b4c8dabcf66d858f4c6b3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:43:28.281647 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:43:28.293364 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837e-ec0e-471e-b3c7-24ae46153b5d service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:43:28.352618 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cc86167294f7c9616a6b3d1573df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76267d843014c29925a4e096c435d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:43:28.353490 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:43:28.353780 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:43:28.354065 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] PATH_INFO: `/v3/projects/aa5c50370f434081ba04274bd912c36c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:43:28.355286 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5c50370f434081ba04274bd912c36c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:43:28.357234 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:43:28.479711 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5c50370f434081ba04274bd912c36c', 'request_id': 'req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.542573 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5c50370f434081ba04274bd912c36c', 'request_id': 'req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.548450 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5c50370f434081ba04274bd912c36c', 'request_id': 'req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.572951 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] The token cache is being invalidate because project aa5c50370f434081ba04274bd912c36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 09:43:28.573249 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.573889 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c1d725e0-ad75-47cc-81ab-bbb5e0202a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 09:43:28.575447 dv-cinder-819149-7-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1460/2915] 10.222.0.61 () {58 vars in 1232 bytes} [Mon Jul 4 09:43:28 2022] DELETE /identity/v3/projects/aa5c50370f434081ba04274bd912c36c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:43:38.019813 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:43:38.570616 dv-cinder-819149-7-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:44:19.913215 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:44:19.914712 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:44:20.004170 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaaca6-5a4c-4b4e-a9f3-1eef500a7517 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:44:20.061753 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7edebd2d5e7048639b43be8ae5288a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f791abde63489fbc08437683a0b314', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:44:20.062435 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:44:20.062726 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:44:20.063010 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:44:20.064793 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:44:20.076156 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:44:20.077747 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26036d-04de-47ed-ba03-f21801c65099 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:44:20.087707 dv-cinder-819149-7-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1456/2916] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Jul 4 09:44:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 09:44:30.083882 dv-cinder-819149-7-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=67 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}